Deutsche Telekom, Orange, Telefónica and Vodafone, together with deep-tech company MATSUKO, are developing an easy-to-use platform for immersive 3D experiences that merge virtuality with reality.
Advances in connectivity thanks to 5G and edge computing technology offered by telecom operators enable smooth and natural movement of holograms and open up a number of possible use cases.
Leading European telecom operators Deutsche Telekom, Orange, Telefónica and Vodafone, along with deep-tech company MATSUKO, have piloted a project to make holographic calls as simple and straightforward as a simple phone call, by interconnecting their deployments to allow their customers to can participate in a joint holographic communication session. The companies are also developing a platform that will combine the real and virtual worlds over a mobile connection, using a smartphone camera to produce a 2D video, which is then rendered into 3D holograms in the cloud to display it viewers in an AR/VR/MR environment with unprecedented clarity and sharpness.
The test platform leverages the attributes of 5G connectivity (high speed, high bandwidth, and low latency) to overcome some of the challenges of creating realistic 3D images that have existed to date. Holograms are created using a smartphone’s selfie camera to capture and transmit a real-time, three-dimensional holographic image of a person before it is processed by an advanced 3D rendering engine. It then delivers an immersive experience “virtually present” and displays it in a virtual environment or overlays it on a real environment using virtual reality/augmented reality glasses.
After successfully completing the first phase of cooperation, the parties will continue to improve the underlying technology, with a focus on service quality. The parties are currently exploring the potential for broadcast-like transmission, creating the ability to host entire events or presentations virtually with breathtaking realism. Future applications could include person-to-person or “few-to-few”, improving communication in both consumer and business environments. Key to this realism is the use of mobile edge computing technology — so-called “distributed networks,” where network and application intelligence is operational farther from the network core — which significantly improves both latency and bandwidth, which can be used for a representation that is as lively and lively as possible is essential for a reliable VR and mixed reality experience.
The results were encouraging thanks to 5G and cutting-edge technology. Fixed previous network-related issues that prevented the holograms from smooth and natural holographic movement. In addition, MATSUKO’s platform ensures that the end result benefits from better color and texture resolution, increased realism when viewed on a smartphone or other mobile device, and without the need for a video headset, enhances the immersive experience.