Tito Ndjekoua Nzeumi
Energy Consumption Prediction.
Rel. Paolo Garza. Politecnico di Torino, Corso di laurea magistrale in Data Science And Engineering, 2025
|
Preview |
PDF (Tesi_di_laurea)
- Tesi
Licenza: Creative Commons Attribution Non-commercial No Derivatives. Download (6MB) | Preview |
Abstract
Developing a Custom Attention Mechanism for Multivariate Time Series Forecasting This thesis work focuses on the development of a new attention mechanism to tailor the Transformer architecture to multivariate time series. In particular, the performance of two attention mechanism were compared. The first is the classical attention mechanism commonly used in ’vanilla’ transformers. The second, that we will refer to a ’cross-attention’, is a modification aimed to improve the projection representation in the attention to learn the most critical features for multivariate time series forecasting. Therefore, three mains use case projections Embedding were introduced. The first tested the influence of the embedding dimension in capturing the long terms dependence and long time, however it could have a better reactivities in the early event.
The Second concerns the intra-day variations improving the model comprehension of daily cycles, the third capture the long tendances and potentially the weekly schemas
Tipo di pubblicazione
URI
![]() |
Modifica (riservato agli operatori) |
