Object Highlighting Within Real-Time 2D and 3D Panorama Video Streaming in Mixed Reality Remote Collaboration

The research focuses on Mixed Reality (MR) remote collaboration, where two individuals cooperate from different locations by sharing real-time visual cues. The aim is to develop a system capable of identifying and emphasising objects specified by a remote user within the local user's environment. The goal is to evaluate the effectiveness and user experience of object highlighting, compared to other MR collaboration techniques, since it could be crucial for commanding the local user's attention to specific objects or areas thus improving the overall communication. Additionally, the system will support interchangeable visualisation of both the 2D and 3D live streaming of the local user's surroundings.The 2D scene, obtained from panorama video feed, will provide more detailed texture information, whereas the 3D scene, generated from a point cloud feed, will offer geometrical information. This research aims to delve deeper into the user experience of remote collaboration using MR technology, improving the effectiveness of remote communication methods, and the overall impact on collaboration.