Francesco Lipani
Data Quality and Observability for Data Mesh Paradigm.
Rel. Paolo Garza. Politecnico di Torino, Master of science program in Ict For Smart Societies, 2023
Abstract
This thesis aimed to create a data quality and observability framework for the data mesh paradigm. Since the combination of observability and data quality techniques ensures the fundamental concept of trustworthiness. The framework was developed to provide a guide for the entire data intelligence business area of NTT Data and to apply it to a case study using sample clickstream data. The work began with a detailed study of data quality techniques and processes, including the entire data lifecycle from collection to publication. In the context of the work described, libraries such as DataFold, Dbt tests, Great Expectations, and Deequ were evaluated to determine which one(s) could best meet the data quality needs of the case study.
This evaluation involved considering factors such as the ease of use, the features offered, and the compatibility with the project's data sources and tools
Relators
Academic year
Publication type
Number of Pages
Additional Information
Course of studies
Classe di laurea
Aziende collaboratrici
URI
![]() |
Modify record (reserved for operators) |
