People blinking in your photos may not be a problem for much longer. Facebook is working on ways to fix them with AI.
AI is used for all kinds of things. Now, Facebook might start using it to fix up your photos – and specifically when there’s a photo in which someone is blinking at the wrong time. Yes, it could ruin the best. AI is pretty smart and could “paint in” those eyes, or make someone smile. But up until now, it’s using other people’s eyes. It doesn’t always look great.
Facebook researchers seem to have found a solution. Use your own eyes or mouth or the owner’s to fix the photo. Pretty simple and ingenious actually. In a recent research paper, titled “Eye In-Painting with Exemplar Generative Adversarial Networks: Computer Vision and Pattern Recognition (CVPR)” Brian Dolhansky and Cristian Canton Ferrer propose using parts of the owner’s face from other photos that Facebook itself has on record.
Dolhansky and Ferrer tried two approaches: One uses a reference image of the eyes, and the second gets a version of the eyes – from Facebook’s facial recognition storage to use in the approach. The researchers trained the AI with actual images of the people in question – at least three images per person.
While the AI helps “paint in” the eyes, the reference library provides the “identity” of the subject. Thus, the AI was able to create much more realistic results. The research led to better accuracy overall, but are far from perfect. The program could not accurately reflect angles and shadows etc. It may be some time before those variations are effectively factored in.
You might also like
More from Facebook
Here are all the training courses you should consider this week, as part of Facebook's free 'Summer of Support' initiative.
Facebook is testing a new design for Facebook Pages that comes without the "Like" count and "Like" button. Is this …
Facebook is bringing the screen-sharing feature, which is already available on Messenger video calls and Messenger Rooms, to Messenger for …
Facebook is contemplating a move to suspend all political advertising on its platform ahead of the 2020 US Presidential election.
Facebook is rolling out a new Community Management course on Blueprint, which is free to join for everyone. What are …
Late last month, Facebook's NPE team announced an invite-only beta for Forecast, an app that lets users make crowdsourced predictions.