Politecnico di Torino (logo)

Attention-based Summarization Approach of Clinical Notes

Rizvan Saatov

Attention-based Summarization Approach of Clinical Notes.

Rel. Maurizio Morisio, Giuseppe Rizzo. Politecnico di Torino, Corso di laurea magistrale in Communications And Computer Networks Engineering (Ingegneria Telematica E Delle Comunicazioni), 2021

PDF (Tesi_di_laurea) - Tesi
Licenza: Creative Commons Attribution Non-commercial No Derivatives.

Download (6MB) | Preview

Deployment of Machine Learning for understanding clinical notes in the healthcare sector is crucial to extract meaningful phrases based on disease types. It is tough for human beings to summarize large documents of text manually. Summarization and evaluation of text are considered challenging tasks in the NLP community. We developed CUI Machine learning models to summarize clinical notes based on multi-head attention mechanisms and evaluate the summaries by applying evaluation metrics. In this thesis work, we propose a multi-head attention-based mechanism to perform extractive summarization of meaningful phrases in clinical summaries from the MIMIC-III dataset. This research helps highlight and perceive helpful information from clinical notes to a physician, and this step will increase treatment quality and support doctor's tasks. We conclude with optimal results compared to statistical-based models, proposing certain limitations and employing new evaluation metrics from a different perspective for future work. We achieved a provable score, which indicates that the BERT (Bidirectional Encoder Representations from Transformers) based model output accuracy is better than the statistical-based solution model and can be employed to summarize extractive summarization methods.

Relators: Maurizio Morisio, Giuseppe Rizzo
Academic year: 2021/22
Publication type: Electronic
Number of Pages: 65
Corso di laurea: Corso di laurea magistrale in Communications And Computer Networks Engineering (Ingegneria Telematica E Delle Comunicazioni)
Classe di laurea: New organization > Master science > LM-27 - TELECOMMUNICATIONS ENGINEERING
Aziende collaboratrici: FONDAZIONE LINKS
URI: http://webthesis.biblio.polito.it/id/eprint/20529
Modify record (reserved for operators) Modify record (reserved for operators)