polito.it
Politecnico di Torino (logo)

AI-guided web crawler for automatic detection of malicious sites

Samuel Oreste Abreu

AI-guided web crawler for automatic detection of malicious sites.

Rel. Tatiana Tommasi. Politecnico di Torino, Corso di laurea magistrale in Ingegneria Informatica (Computer Engineering), 2023

Abstract:

Crawling the web with the purpose of finding malicious sites is still an open problem given how the internet is a highly dynamic environment, this constant change makes it difficult to consistently traverse it, for this reason the application of artificial intelligence methods, in particular those belonging to reinforcement learning are studied in this thesis. A method inspired by advances in Machine Learning and classic reinforcement learning paradigms, such as multi-armed bandits, is presented and applied to an experimental environment. Such environment consists of a graph of the internet and was produced by the employment of a breadth-first search universal crawler that traverses the web and saves its travelled path, which corresponds to a snapshot of how sites are interconnected. The feasibility and the results obtained with such methods are discussed accordingly.

Relators: Tatiana Tommasi
Academic year: 2022/23
Publication type: Electronic
Number of Pages: 53
Additional Information: Tesi secretata. Fulltext non presente
Subjects:
Corso di laurea: Corso di laurea magistrale in Ingegneria Informatica (Computer Engineering)
Classe di laurea: New organization > Master science > LM-32 - COMPUTER SYSTEMS ENGINEERING
Aziende collaboratrici: ERMES CYBER SECURITY S.R.L.
URI: http://webthesis.biblio.polito.it/id/eprint/26883
Modify record (reserved for operators) Modify record (reserved for operators)