Following the rollout of YouTube Stories to all eligible creators back in November, Google is now bringing a range of AI-powered augmented reality Creator Effects as well.
In November, we reported that Google rolled out YouTube Stories to all eligible creators with over 10k subscribers after testing the feature with a small group of creators. Now, Google is taking on Facebook, Instagram, and Snapchat with new AR effects like animated masks, hats, glasses, and more, that creators can add to their videos.
As Artsiom Ablavatski and Ivan Grishchenko, Research Engineers at Google Artificial Intelligence (AI), explain in a recent blog post:
“One of the key challenges in making these AR features possible is proper anchoring of the virtual content to the real world; a process that requires a unique set of perceptive technologies able to track the highly dynamic surface geometry across every smile, frown or smirk.”
To make this possible, Google is using Machine Learning to track dynamic surfaces and geometries, which will also help improve accuracy to make effects look a lot more realistic. “We employ Machine Learning (ML) to infer approximate 3D surface geometry to enable visual effects and ML Pipeline for Selfie AR.” Thus, the feature should work as well with just one camera.
The results are more realistic selfie AR effects that simulate light reflections with environmental mapping to render glasses, to cast virtual object shadows onto the face mesh, and to model face occlusions to hide virtual object parts behind a face – i.e. the virtual glasses below.
Google is employing similar technologies to bring AR features to Google Maps, announced last month.
You might also like
More from Google
Google Maps Will Soon Suggest More Eco-Friendly Routes
As part of Google's commitment to helping users reduce their environmental footprint, Maps will soon default to routes that have …
Google Makes It Easier To Find Shared Files On Drive
Google is updating search operators in Google Drive to make it easier to find shared files.
Google Brings Live Captions For Media With Audio On Chrome
Google has announced that its Live Caption feature is now available to all on Chrome, letting users automatically add captions …
Google Now Lets You Snooze Calendar Desktop Notifications
Google is rolling out a new feature that lets you snooze your desktop Google Calendar notifications.
Google Calendar Now Lets You Split Your Workday Into Segments
Google Calendar is introducing work hour segmentation and repeating out-of-office replies to help you organize your hectic schedule.
Google Photos Gets A New Video Editor
After launching its new photo editor on Android last year, Google Photos is now rolling out a new video editor …
Chrome Now Mutes Notifications When You Are Sharing Your Screen
Chrome is giving users more privacy and fewer distractions, by muting web notifications while screen sharing.
Google Now Lets You Check Your Video And Sound Before Joining A Meet Call
Google has announced a new feature that lets you quickly preview how you look on camera before going on a …
Google Now Adds More Context To Search Results Before You Click On Them
Google has started testing a feature that provides information about search results - letting users get more context about them.
