Andrea Cucchietti
Goal-Conditioned Reinforcement Learning for Autonomous Perceptive Earthworks in Particle-Based Soil Simulation.
Rel. Raffaello Camoriano. Politecnico di Torino, Master of science program in Data Science And Engineering, 2026
|
Preview |
PDF (Tesi_di_laurea)
- Thesis
Licence: Creative Commons Attribution Non-commercial No Derivatives. Download (47MB) | Preview |
Abstract
The construction industry faces a shortage of workers, while earthmoving tasks remain difficult to automate because they require both tracking the evolving terrain and handling soil dynamics as the machine interacts with the material. This thesis studies how a reinforcement-learning pipeline can be structured to address this problem in Newton simulation with particle-based terrain representation, focusing on loose-soil surface manipulation in a setup where the shovel interacts with the soil as a kinematic collider. The policies are trained with Proximal Policy Optimization (PPO), with the largest runs using up to 2048 environments in parallel. A generic current-terrain / target-terrain framework is introduced and evaluated first on a Flattening Task with a flat, volume-consistent target, and then on a broader General Shaping Task with plane and smooth sinusoidal target surfaces.
On the Flattening Task, the learned policy reduces the mean full-grid terrain error from about 0.150 m at episode start to about 0.100 m at episode end
Relators
Academic year
Publication type
Number of Pages
Course of studies
Classe di laurea
Ente in cotutela
Aziende collaboratrici
URI
![]() |
Modify record (reserved for operators) |
