Tito Ndjekoua Nzeumi
Energy Consumption Prediction.
Rel. Paolo Garza. Politecnico di Torino, Master of science program in Data Science And Engineering, 2025
|
Preview |
PDF (Tesi_di_laurea)
- Thesis
Licence: Creative Commons Attribution Non-commercial No Derivatives. Download (6MB) | Preview |
Abstract
Developing a Custom Attention Mechanism for Multivariate Time Series Forecasting This thesis work focuses on the development of a new attention mechanism to tailor the Transformer architecture to multivariate time series. In particular, the performance of two attention mechanism were compared. The first is the classical attention mechanism commonly used in ’vanilla’ transformers. The second, that we will refer to a ’cross-attention’, is a modification aimed to improve the projection representation in the attention to learn the most critical features for multivariate time series forecasting. Therefore, three mains use case projections Embedding were introduced. The first tested the influence of the embedding dimension in capturing the long terms dependence and long time, however it could have a better reactivities in the early event.
The Second concerns the intra-day variations improving the model comprehension of daily cycles, the third capture the long tendances and potentially the weekly schemas
Relators
Academic year
Publication type
Number of Pages
Course of studies
Classe di laurea
URI
![]() |
Modify record (reserved for operators) |
