As part of its work to help people discover ideas visually, Pinterest is working on a new scene-based complementary recommendation system that identifies the context in a scene, to make better recommendations.
Pinterest’s Visual Search is good at identifying specific objects in query images, as the objective is to provide search results that are visually similar. However, Pinterest is also working on ways to identify and return visual components that are part of a broader “scene” – not just the subject of any given query image.
As Pinterest explains in a recent post, ‘Complete the Look’ is a system “which leverages rich scene context to recommend visually compatible results in Fashion and Home Decor Pins.” It takes context “like an outfit, body type, season, indoors vs outdoors, various pieces of furniture, and the overall aesthetics of a room,” and brings back “taste-based recommendations across visual search technology.”
While visual search predicts compatibility between any product image (it contains something specific like a t-shirt), it tends to ignore parts of real scenes. For example, a street style Pin can be complex, but it can also provide context. The answer to this issue is Complete the Look – a visual complement system that can recommend results that complement, or go well with, a specific query image.
Results don’t have to be visually similar, “but can explore alternate dimensions of stylistic similarity.” Essentially, it’s a system that can suggest results to complete an outfit or scene. This could mean finding a perfect fit with a specific pair of shoes, or perfect chairs for a new table.
You might also like
More from Pinterest
Pinterest Launches Today Tab In Australia To Mark NAIDOC Week
Pinterest is bringing its Today tab to Australia to celebrate National Aborigines and Islanders Day Observance Committee (NAIDOC) week.
Far Beyond Fashion: Leveraging Pinterest Influencers
Pinterest influencers can help promote your business thanks to its friction-less approach during the acquisition process.
Pinterest Announces New Shopping And Ad Features In Time For The Holiday Season
Kicking off this year's Advertising Week, Pinterest is rolling out new shopping tools, among them, ads in visual search results and …
Pinterest Introduces Story Pins And Other New Features For Creators
Pinterest announced a few updates for creators, including Story Pins in beta, a new creator profile, updated analytics, and more.
Pinterest Launches Brand New Shop Collection Featuring Black-Owned Businesses
In celebration of National Black Business Month, Pinterest launched a new Pinterest Shop collection with Black-owned fashion and beauty businesses.
Pinterest Announces Updates To Its Inclusive Beauty Search Feature
Pinterest is updating skin tone ranges in its inclusive beauty results search feature, and opening its AR Try on feature …
Gen Z, Men, And Millennials Drive Pinterest Growth Past 400M MAUs
Pinterest last week announced it has reached its milestone of 400 million monthly active users with Gen Z, men, and …
Pinterest Launches ‘Chefs At Home’ Initiative
Pinterest is launching the Chefs at Home initiative and donating $300,000 in free advertising for the restaurant industry.