Google is contemplating the event of a brand new chatbot that’s able to telling the story of a consumer’s life primarily based on their pictures and search historical past, in line with a current CNBC report. The search big might use massive language fashions (LLMs), such because the just lately unveiled multimodal Gemini mannequin, as a part of a brand new AI venture. Gemini is touted to compete with OpenAI’s GPT-4 mannequin, and Google claims that its top-of-the-line mannequin outperforms its closest competitor on some benchmarks.
A CNBC report that cites inside paperwork states that considered one of Google’s AI groups has advised that the corporate develop an AI-based expertise to make use of information from customers’ smartphones — together with pictures and their search exercise — that shall be consumed by an AI-powered chatbot. The venture, dubbed Project Ellman, can then use the knowledge to supply solutions to “previously impossible questions”, in line with the report.
Instead of merely counting on “just pixels with labels and metadata”, Project Ellman would attempt to spot patterns in a consumer’s pictures, learning pictures and reminiscences earlier than and after the picture to achieve context, in line with the report. The firm’s inside doc additionally envisions “Ellman Chat” turning into “Your Life Story Teller.”
Google at present collects consumer’s pictures which are saved on the corporate’s servers as a part of its Google Photos backup and sync characteristic. The firm didn’t specify whether or not the info supply could be from Google Photos synced to the cloud, or whether or not the photographs could be processed on the consumer’s gadget.
“This was an early internal exploration and, as always, should we decide to roll out new features, we would take the time needed to ensure they were helpful to people, and designed to protect users’ privacy and safety as our top priority”, an organization spokesperson instructed the publication.
It is unclear whether or not Google is actively engaged on including help for such a personalised AI chatbot that depends on its new Gemini AI fashions, which had been unveiled by the corporate final week. Google’s strongest mannequin — Gemini Ultra — will not be obtainable till subsequent yr and is able to outperforming OpenAI’s GPT-4 mannequin in some checks, in line with Google.
