polito.it
Politecnico di Torino (logo)

Exploring Relevance-Based Pruning Strategies in VGG Models: A Comparative Study

Zhiqiang Zhao

Exploring Relevance-Based Pruning Strategies in VGG Models: A Comparative Study.

Rel. Carla Fabiana Chiasserini. Politecnico di Torino, Corso di laurea magistrale in Ict For Smart Societies (Ict Per La Società Del Futuro), 2024

[img]
Preview
PDF (Tesi_di_laurea) - Tesi
Licenza: Creative Commons Attribution Non-commercial No Derivatives.

Download (2MB) | Preview
Abstract:

This thesis investigates the effectiveness of different pruning strategies in VGG16 models. The study begins with the evaluation of the CIFAR-10 dataset using a VGG16 model, followed by the calculation of the model’s relevance using a method from the TorchLRP repository. Two pruning strategies were then implemented based on the calculated relevance data. The first strategy involved pruning the model based on the absolute mean value of the relevance of the channels. The second strategy used the absolute mean of the model parameters for pruning. Both methods were applied at varying pruning percentages, and their performances were compared. However, significant performance differences between the two methods were not observed until a combined approach was implemented. This combined method involved calculating the absolute mean value of both the relevance data and the parameters of the channels, sorting them, and alternating their order to form a new pruning list. The results showed that the combined pruning strategy allowed the model to maintain high accuracy and low loss, even at high pruning percentages, outper??forming the other two methods. This study provides valuable insights into the potential of relevance-based pruning strategies in enhancing the performance of VGG models

Relatori: Carla Fabiana Chiasserini
Anno accademico: 2023/24
Tipo di pubblicazione: Elettronica
Numero di pagine: 88
Soggetti:
Corso di laurea: Corso di laurea magistrale in Ict For Smart Societies (Ict Per La Società Del Futuro)
Classe di laurea: Nuovo ordinamento > Laurea magistrale > LM-27 - INGEGNERIA DELLE TELECOMUNICAZIONI
Aziende collaboratrici: NON SPECIFICATO
URI: http://webthesis.biblio.polito.it/id/eprint/30895
Modifica (riservato agli operatori) Modifica (riservato agli operatori)