Immersive Panoramic Communication between Remote Users via Mixed Reality System

Technology Overview

Advances in telecommunication technologies have made video conferencing an integral part of our daily lives. Video conferencing is widely used for communication across remote locations in a number of industries, which allows users to exchange information and share experiences with each other, despite the distance.

The sharing of panoramic videos, facilitated by 360° cameras has allowed for video conferencing with greater immersion, and social media platforms are providing live broadcasting features. Currently, panoramic videos are restricted to broadcasting the host’s view only, limiting the remote user’s understanding of the host’s real environment.

Improving the interactivity and providing a more immersive visual experience for users could lead to greater utility and wider acceptance of panoramic video conferencing.

Technology Features & Specifications

Our technology is a Mixed Reality panoramic collaboration platform. It combines an Augmented Reality experience for the host user with a Virtual Reality (VR) experience for the guest user. Importantly, the technology allows view independence, with guest users able to scope the host user’s surroundings independent of the host’s orientation.

Our technology also incorporates view awareness cues that allow the users to see which direction the other person is facing.

Finally, this technology uses motion sensing in the VR environment to create a 3D virtual image of the guest user’s hand gestures for the host. In this way the remote user can use natural hand gestures to communicate with the host user and show points of interest.

Potential Applications

This technology can be used for remote assistance in fields such as mining, engineering, teaching and telehealth.

It is ideal for applications where the remote user needs to have good awareness of the local host’s environment, and to help them on real world tasks.

Market Trends and Opportunities

Our organisation's venture arm is also seeking research and code development partners for further development of this opportunity.

Customer Benefits

  • Remote problem solving
  • Reduced FIFO operating expense
  • Guest users can view the host’s location independent of host’s orientation
  • Users can easily understand where other users are looking 
  • Non-verbal communication using hand gestures

Make an Enquiry