Qualcomm has showcased a spread of latest generative artificial intelligence (AI) options for Android smartphones at the Mobile World Congress (MWC) 2024 occasion. These options will likely be powered by Snapdragon and Qualcomm platforms and will likely be solely inside the gadget. Besides unveiling a devoted massive language mannequin (LLM) for multimodal responses and a picture technology software, the corporate additionally added greater than 75 AI fashions that can be utilized by builders to construct particular apps.
In a put up, Qualcomm introduced all of the AI options it revealed at the MWC. A serious spotlight is that in contrast to most fashionable AI fashions similar to ChatGPT, Gemini, and Copilot, which course of data on servers, Qualcomm’s AI fashions are solely localised inside the gadget. The on-device options and apps made utilizing these fashions can then be personalised for customers, along with minimising privateness and reliability-related points. For this goal, the chipmaker has made greater than 75 open-source AI fashions, together with Whisper, ControlNet, Stable Diffusion, and Baichuan 7B, obtainable to builders by Qualcomm AI Hub, GitHub, and Hugging Face.
The firm says that these AI fashions may also take much less computational energy and can price much less to construct apps on since they’re optimised for its platforms. However, the truth that all 75 fashions are small in measurement and made for specific duties can be a contributing issue. So, whereas customers won’t see a one-stop store chatbot, these would provide ample use instances for area of interest duties similar to picture modifying or transcription.
To make the method of creating apps utilizing the fashions quicker, Qualcomm has added a number of automation processes to its AI library. “The AI model library automatically handles model translation from source framework to popular runtimes and works directly with the Qualcomm AI Engine direct SDK, then applies hardware-aware optimizations,” it acknowledged.
Apart from the small AI fashions, the American semiconductor firm additionally unveiled LLM instruments. These are at present within the analysis section and have been solely demonstrated at the MWC occasion. The first is Large Language and Vision Assistant (LLaVA), a multimodal LLM with greater than seven billion parameters. Qualcomm mentioned it could possibly settle for a number of kinds of knowledge inputs, together with textual content and pictures, and generate multi-turn conversations with an AI assistant about a picture.
Another software that was demonstrated is named the Low Rank Adaptation (LoRA). It was demoed on an Android smartphone and might generate AI-powered photos utilizing Stable Diffusion. It will not be an LLM itself, nevertheless, it could possibly scale back the variety of trainable parameters of AI fashions to make them extra environment friendly and scale-ready. Besides its utilization in picture technology, Qualcomm claimed that it can be used for customised AI fashions to create tailor-made private assistants, improved language translation, and extra.
For particulars of the newest launches and information from Samsung, Xiaomi, Realme, OnePlus, Oppo and different firms at the Mobile World Congress in Barcelona, go to our MWC 2024 hub.
