polito.it
Politecnico di Torino (logo)

Data Science for Information Security with Open Source technologies

Ventrella, Carlo

Data Science for Information Security with Open Source technologies.

Rel. Elena Maria Baralis. Politecnico di Torino, Corso di laurea magistrale in Ingegneria Informatica (Computer Engineering), 2018

[img]
Preview
PDF (Tesi_di_laurea) - Tesi
Accesso al documento: Accesso libero
Licenza: Creative Commons Attribution Non-commercial No Derivatives.

Download (1MB) | Preview
Abstract:

In the context of the European Commission, a logging monitoring system based on open source technologies is designed and developed for two web applications, named PABS and SYSPER. The architecture is based on the ELK stack, which comprises Elasticsearch, Logstash and Kibana to parse, store, perform queries on the logs and visualize the results. In addition, two custom python-based modules are developed: a log retriever and a log analyzer. The former is used to pull the logs from the servers and to feed them into Logstash. The latter applies a number of anomaly detection techniques to monitor several metrics of the monitored applications. An LSTM based network and a regressive model analyze access logs to detect respectively short and long term anomalies regarding the system utilization. To facilitate the troubleshooting process, exceptions triggered within the application are clustered through DBSCAN; the number of exceptions raised from within the same group is analyzed for anomalies through Robust Z-Score. Finally, the same technique, the Robust Z-Score, is exploited to monitor access to sensitive data.

Relatori: Elena Maria Baralis
Anno accademico: 2018/19
Tipo di pubblicazione: Elettronica
Soggetti:
Corso di laurea: Corso di laurea magistrale in Ingegneria Informatica (Computer Engineering)
Classe di laurea: Nuovo ordinamento > Laurea magistrale > LM-32 - INGEGNERIA INFORMATICA
Ente in cotutela: European Comission DIGIT.B.2 (BELGIO)
Aziende collaboratrici: European Commission DIGIT.B.2
URI: http://webthesis.biblio.polito.it/id/eprint/8504
Modifica (riservato agli operatori) Modifica (riservato agli operatori)