Following the rollout of YouTube Stories to all eligible creators back in November, Google is now bringing a range of AI-powered augmented reality Creator Effects as well.
In November, we reported that Google rolled out YouTube Stories to all eligible creators with over 10k subscribers after testing the feature with a small group of creators. Now, Google is taking on Facebook, Instagram, and Snapchat with new AR effects like animated masks, hats, glasses, and more, that creators can add to their videos.
As Artsiom Ablavatski and Ivan Grishchenko, Research Engineers at Google Artificial Intelligence (AI), explain in a recent blog post:
“One of the key challenges in making these AR features possible is proper anchoring of the virtual content to the real world; a process that requires a unique set of perceptive technologies able to track the highly dynamic surface geometry across every smile, frown or smirk.”
To make this possible, Google is using Machine Learning to track dynamic surfaces and geometries, which will also help improve accuracy to make effects look a lot more realistic. “We employ Machine Learning (ML) to infer approximate 3D surface geometry to enable visual effects and ML Pipeline for Selfie AR.” Thus, the feature should work as well with just one camera.
The results are more realistic selfie AR effects that simulate light reflections with environmental mapping to render glasses, to cast virtual object shadows onto the face mesh, and to model face occlusions to hide virtual object parts behind a face – i.e. the virtual glasses below.
Google is employing similar technologies to bring AR features to Google Maps, announced last month.
You might also like
More from Google
Google Tests Adding TikTok And Instagram Videos To Search Results On Mobile
Google is testing a new feature that will bring TikTok and Instagram videos into a carousel at the top of …
Google Adds Subscriptions Page To The Google Store
Google is using the Google Store to promote its various subscriptions, with a new dedicated page.
Google Lets Users Try On Makeup In AR
Google is launching a new AR-powered feature that lets users try on makeup and lipstick on its app.
Google Meet Adds Live Captions In Four New Languages
Google is rolling out live caption support in Google Meets in four new languages: French, German, Portuguese, and Spanish.
Google Is Testing Dark Mode In Desktop Search
According to reports, Google is testing a new dark mode in its desktop search experience.
Google Brings Messaging And Customer Insights To Google Maps And Search
Google is bringing messaging capabilities and customer insights on Google Maps and Search to help businesses answer questions from the …
Google Launches New Version Of Crawl Stats Report In Search Console
Google last week announced a new version of its Crawl Stats report within Google Search Console.
Google Photos Will End Its Free Unlimited Storage
Google Photos will stop offering unlimited free photo backups on June 1st, 2021. After 15 gigs, you will have to …
Google Rolls Out Family Sharing On Stadia
Google last week announced that it's bringing a family sharing feature to its Stadia cloud gaming service.