Google is combining AI and 3D to render video calls sound as though you’re talking to someone who’s right in front of you.
Google use over the last year, we’ve all become used to video messaging sites like Zoom and Google Meet, as well as the exhaustion and anxiety that can accompany hours of video calls, technical bugs, and staying in one spot looking at all those boxes. But what if video messaging was more like sitting across from a human individual and conversing in a relaxed manner?
Project Starline, which Google announced during its Google I/O developer conference keynote on Tuesday, utilises innovative technologies to take video calls to the next stage. You sit in front of what seems to be a window and see another human, life-size and in three dimensions, on the other hand. As if you were seated across from each other at a table, you will speak spontaneously and make motions and eye contact.
Instead of using video call, Google’s Project Starline lets it seem as though you’re chatting to someone in real life through a browser.
Google Project Starline blends technologies such as computer vision, machine learning, spatial audio, and real-time compression with technology such as a modern light field display device to produce more volume and complexity without the use of augmented reality or virtual reality glasses or goggles. According to Google executives, this gives the impression that an individual is seated across from you, and the technologies will fade away.
During the pandemic, Google Meet has been a common option for working and socialising, and Google has introduced many different updates to make it simpler for users to communicate over the course of the year (and to compete with others like Zoom and Microsoft Teams). However, Project Starline goes well beyond just allowing you to adjust your video chat history.
With Umi, a high-definition monitor and microphone built into your TV for improved video calls, Cisco tested out a similar but somewhat lower-tech concept in 2010, with a $599 price tag. It was phased out for only two years. And, more recently, several applications on the market, such as Spatial, have attempted to bring the interactive meeting model into virtual reality, but none have taken off, owing in part to the headsets’ high cost and lack of comfort.
Project Starline creates a 3D rendering of the person you’re talking with using computer vision, machine intelligence, spatial audio, and real-time compression, as well as a new light field display technology.
In terms of customer acceptance, Google Project Starline can face related challenges: It necessitates sophisticated, custom-built equipment that is actually only accessible in a handful of Google offices. To get early reviews, the organisation demoed it with health care and media clients, and is preparing pilot deployments in the enterprise room later this year. Google, on the other hand, stated that its mission is to render Project Starline technology more affordable and usable, as well as to incorporate some of the new features into its current communication tools.
In a blog post, Google stated that further details would be available later this year.
Google also created a revolutionary videoconferencing technology that allows each group to see each other in 3D. You won’t be running Project Starline on your desktop any time soon; it entails a slew of sensors, computer vision and machine learning applications, and “a revolutionary light field display technology,” according to Google, “that provides a sense of scale and depth that can be achieved without the use of external glasses or headsets.“
Here’s how it works in practise:
The technology appears to be cutting-edge, but I believe the physical arrangement should be improved; the way it’s set up, it appears like the two parties are conversing through a jail visitation slot, which I’m sure isn’t the vibe they’re going for.