Seyedmohammad Khataeipour
Augmented Reality Mediated Control of a UR3e Collaborative Robot Using HoloLens 2: A Point and Pick Interface with ROS Integration.
Rel. Luca Mastrogiacomo, Matteo Capponi. Politecnico di Torino, Master of science program in Computer Engineering, 2026
|
Preview |
PDF (Tesi_di_laurea)
- Thesis
Licence: Creative Commons Attribution Non-commercial No Derivatives. Download (3MB) | Preview |
Abstract
Enhancing Collaborative Robotics: Controlling the UR3e Robot Using HoloLens 2 with Hand Gestures and Voice CommandsThis thesis investigates the use of augmented reality as an interaction layer for collaborative robotic manipulation in a structured workstation scenario. The proposed system is developed for a Universal Robots UR3e collaborative robot equipped with an OnRobot RG6 gripper and uses Microsoft HoloLens 2 as the primary interaction device. The AR application is implemented in Unity with the Mixed Reality Toolkit, while communication with the robotic system is handled through a ROS Noetic backend via ROS# WebSockets. The interaction model combines hand gestures, voice commands, and a Point and Pick paradigm.
Through this approach, the operator designates targets directly in three-dimensional space using a pointing interaction, while execution is triggered only through a deliberate user command
Relators
Academic year
Publication type
Number of Pages
Course of studies
Classe di laurea
URI
![]() |
Modify record (reserved for operators) |
