People blinking in your photos may not be a problem for much longer. Facebook is working on ways to fix them with AI.
AI is used for all kinds of things. Now, Facebook might start using it to fix up your photos – and specifically when there’s a photo in which someone is blinking at the wrong time. Yes, it could ruin the best. AI is pretty smart and could “paint in” those eyes, or make someone smile. But up until now, it’s using other people’s eyes. It doesn’t always look great.
Facebook researchers seem to have found a solution. Use your own eyes or mouth or the owner’s to fix the photo. Pretty simple and ingenious actually. In a recent research paper, titled “Eye In-Painting with Exemplar Generative Adversarial Networks: Computer Vision and Pattern Recognition (CVPR)” Brian Dolhansky and Cristian Canton Ferrer propose using parts of the owner’s face from other photos that Facebook itself has on record.
Dolhansky and Ferrer tried two approaches: One uses a reference image of the eyes, and the second gets a version of the eyes – from Facebook’s facial recognition storage to use in the approach. The researchers trained the AI with actual images of the people in question – at least three images per person.
While the AI helps “paint in” the eyes, the reference library provides the “identity” of the subject. Thus, the AI was able to create much more realistic results. The research led to better accuracy overall, but are far from perfect. The program could not accurately reflect angles and shadows etc. It may be some time before those variations are effectively factored in.
You might also like
More from Facebook
Facebook is celebrating Messenger's 10th birthday with the release of an epic bundle of 10 new product features.
Facebook is testing the integration of Messenger features back into its main app, seven years after separating the two.
Facebook is working with the International Paralympic Committee (IPC) to bring the Tokyo 2020 Paralympic Games to people via Facebook …
Facebook is reimagining the collaborative workspace with Horizon Workrooms, letting people meet and work together in VR and mixed-reality.
Facebook is expanding its encryption option to cover voice chats and video calls instead of just text chats.