Deutsche Telekom, Orange, Telefónica and Vodafone, as well as deep tech Matsuko, develop an easy-to-use platform for immersive 3D experiences that mix virtuality and reality.
The metaverse brings a new dimension into the future of connectivity, with exciting new experiences for communicating with friends and family or companies that connect with their stakeholders. The proof of concept below dramatically shifts holographic communications from science fiction to real-life smartphones. Operators want, through this unique multi-operator collaboration, to prepare their infrastructure to provide open, interoperable and easy-to-use holographic communications.
Making phone calls as if the person I’m talking to is standing in front of me now seems closer to reality.
Startup Matsuko together with 3 mobile operators Deutsche Telekom, Orange, Telefónica and Vodafone conducted a pilot project to make holographic calls as easy and simple as making a simple phone call by interconnecting their installations so that their customers can participate in a common holographic communication session. This is made possible by advances in 5G connectivity and state-of-the-art information technology offered by telecom operators, allowing for fluid and natural movement of holograms, opening up a range of possible use cases. Holograms are created using a smartphone’s selfie camera to capture and transmit a real-time three-dimensional holographic image of a person.
They had launched a hologram during the Tour de France which allowed Christian Prudhomme to address the fans in augmented reality which allowed to appear in 3D on the augmented reality glasses of the fans with a 3D map of the race and information keys for each step. Matsuko’s solution is not an animated avatar but a fully expressive hologram. Using mixed and augmented reality and artificial intelligence, the startup creates 3D holograms for remote communication between people. This eliminates the problems often encountered in video calls: lack of non-verbal cues, lack of involvement and missing feeling. Founded in 2017, the startup is building an all-software solution with a conversation starter app that allows people to model in three dimensions and move them into real space and in real time. What makes it unique is the use of a unique camera found in smartphones or computers.
Holographic communication, a fully immersive three-dimensional experience with spatial awareness, is available, but there are obstacles to greater adoption. It is extremely data-intensive, so new processing techniques are needed, especially in the network, to enable more traditional solutions.
Mobile operators are also developing a platform that will combine the real and virtual world over a mobile connection, using a smartphone camera to generate 2D video which is then rendered into 3D holograms in the cloud to be streamed to viewers in an AR environment. MR with sharpness and sharpness never before possible. The parties are also exploring the potential of a broadcast, creating the ability to organize entire events or presentations virtually with extraordinary realism, including one-on-one conversations!
Matsuko’s platform ensures that the end result boasts better color and texture resolutions, increasing realism when viewed on a smartphone or other mobile device, and without the need for video headsets will enhance the immersive experience. Improvements in artificial intelligence and new or improved capabilities will allow networks to adapt, based on user behavior and routines, while anticipating what will be required of the network to improve overall network quality and reliability.
Ericsson is also working on the topic of holographic conversations, with a latency of one millisecond, the time between an action response provided by 5G, the ability to distinguish hard objects from soft objects (tactile skills) and to mimic your movements. and your stamina through remote robots (kinesthetic abilities) are improving at an incredible rate. By 2030, this will be further extended so that every human sense is digitally transformed to enable fully immersive experiences. The ability to virtually teleport to a distant place will cloud what you can experience in the virtual and physical worlds is on the way …