Politecnico di Torino (logo)

Biologically plausible learning algorithms for recurrent neural networks

Mattia Della Vecchia

Biologically plausible learning algorithms for recurrent neural networks.

Rel. Andrea Pagnani, Vincent Hakim. Politecnico di Torino, Corso di laurea magistrale in Physics Of Complex Systems (Fisica Dei Sistemi Complessi), 2021

PDF (Tesi_di_laurea) - Tesi
Licenza: Creative Commons Attribution Non-commercial No Derivatives.

Download (1MB) | Preview

The very first works that gave light to the field of Artificial Intelligence were heavily influenced by the study of the brain, and carried out by collaborative efforts of computer- and neuro-scientists. Progressively, the models and methods proposed have distanced themselves from this approach, towards ones more oriented to informatics. In the last years, a resurgence of interest in works that bridge the two fields has taken action, thanks also to development of tools that allows to investigate the brain with a extraordinary level of detail. Biological mechanisms act as a natural source of inspiration for innovative techniques applicable to artificial networks. The project of this internship positions itself in this trend. The objective is to implement a training procedure for recurrent neural networks starting from considerations on the cerebellum. A form of Stochastic Gradient Descent has been proposed to be performed by this structure, involved in the coordination of motor actions. Activity of neurons is perturbed in a stochastic manner that results in a change of the global error. Synaptic plasticity is carried out integrating information about perturbations and error evolution. Two training algorithms for recurrent neural networks are taken as a base for investigation on the temporal dynamics and learning in this special class of networks, and are progressively modified to implement the mechanism proposed for cerebellar learning.

Relators: Andrea Pagnani, Vincent Hakim
Academic year: 2021/22
Publication type: Electronic
Number of Pages: 38
Corso di laurea: Corso di laurea magistrale in Physics Of Complex Systems (Fisica Dei Sistemi Complessi)
Classe di laurea: New organization > Master science > LM-44 - MATHEMATICAL MODELLING FOR ENGINEERING
Ente in cotutela: Ecole normale supérieure (FRANCIA)
Aziende collaboratrici: Ecole Normale Superieure
URI: http://webthesis.biblio.polito.it/id/eprint/20437
Modify record (reserved for operators) Modify record (reserved for operators)