Google announced it has built a chatbot that can have conversations that are far better than any other state-of-the-art chatbot currently out there.
If you’ve ever tried to have a general conversation with any virtual assistant or chatbot, you will have noticed how they only perform well if you stick to what they were built to do. That’s because modern chatbots, or “conversational agents” as Google calls them, are specialized and aren’t good at handling the wide variety of topics that humans usually discuss.
On the other hand, “open-domain chatbots” – those that can handle more general conversations as opposed to responding to specific keywords – have a critical flaw: “They often don’t make sense.”
To solve both problems, Google attempted to develop a chatbot that is not specialized and can chat about virtually anything. The result is Meena, “a 2.6 billion parameter end-to-end trained neural conversational model.” Meena can conduct conversations that are both more sensible and more specific than those with existing state-of-the-art chatbots.
To measure this, researchers came up with a new metric called Sensibleness and Specificity Average (SSA). In a recent paper, they explain that SSA “captures key elements of good conversation,” and that research has shown a “strong correlation between perplexity and SSA.” The higher the SSA, the lower the perplexity.
Remarkably, Meena scores an SSA of 79%, while human-level SSA is around 86%. The next best chatbot currently out there scores 23% lower than Meena.
This means that there is significant potential to reach human SSA if perplexity is further optimized and, in this case, lowered.
This is exactly what Google’s researchers are aiming for, but more research is necessary at this point.
A chatbot with the ability to chat about virtually anything that users can throw at it has a wide variety of interesting applications, such as “further humanizing computer interactions, improving foreign language practice, and making relatable interactive movie and videogame characters.”
While the team has so far focused on sensibleness and specificity, future attributes – like personality and factuality – are also worth considering.
Finally, the research doesn’t come without challenges, and that’s why Google will not be releasing a demo for external use right now. The team needs first to tackle things like safety and bias before this can happen.
You might also like
More from Google
Google Product Studio Lets Merchants Create Product Imagery With Generative AI
Google is launching Product Studio, a new tool that lets merchants create product imagery for free, using generative AI. Google Product …
Google Will Delete Accounts That Have Been Inactive For Two Years
Google said it plans to delete account that have not accessed any of its services for two years, as part …
Google I/O Keynote Round-Up: All-In On AI
During its I/O keynote, Google showed off its latest advances in AI, across search, photo editor and Bard, its own …
No More Passwords, Google Is Rolling Out Passkeys Globally
You no longer require a password to sign in on to your Google account, with passkeys rolling out to all …
Tech Companies Are Teaming Up To Free Us From Passwords
Apple, Google, and Microsoft are committing to expanded support for the FIDO standard to bring a passwordless future.
You Can Now Create Custom Voices With Google Cloud Text-to-Speech API
Google Cloud has announced a new feature within its TTS API that lets users generate a unique, new synthetic voice …
Google Replaces Classic Hangouts With Chat On Workspace
On March 22, users attempting to access Google's Hangouts chat services will automatically be redirected to Google Chat instead.
Google Rolls Out New Search Filters To All Users On Drive
Almost two years after introducing search chips into Gmail, Google has now announced the rollout of supportive filters to Google …
Google Unveils Early Access To Chrome OS Flex For PCs And Macs
Google has announced early access to Chrome OS Flex, a new version of Chrome OS that will bring the benefits …
