Salvatore Fiscale
Evaluating Large Language Models on Project Management and Business Analysis Processes: A Methodological Framework for Automated Benchmarking.
Rel. Filippo Maria Ottaviani. Politecnico di Torino, Corso di laurea magistrale in Ingegneria Gestionale (Engineering And Management), 2026
|
Preview |
PDF (Tesi_di_laurea)
- Tesi
Licenza: Creative Commons Attribution Non-commercial No Derivatives. Download (1MB) | Preview |
Abstract
The rapid adoption of large language models (LLMs) in knowledge-intensive professions has outpaced the development of rigorous methods for assessing their performance on domain-specific tasks. While general-purpose benchmarks abound, the project management and business analysis disciplines lack a structured, reproducible means of measuring how well such models support core professional processes. This thesis addresses that gap by designing and operationalising a methodological framework for the automated benchmarking of LLMs across project management and business analysis activities. The framework is grounded in a practitioner survey that identified and validated seven macro-processes central to the two disciplines. From these processes, twelve operational tasks were derived, spanning estimation, scheduling, dependency identification, risk and stakeholder analysis, requirements elicitation, and related activities.
A second survey established the measurement validity of twenty-four evaluation criteria, organised around three trade-off families and mapped to the twelve tasks
Relatori
Anno Accademico
Tipo di pubblicazione
Numero di pagine
Corso di laurea
Classe di laurea
URI
![]() |
Modifica (riservato agli operatori) |
