Qualcomm CEO Predicts LLMs Will Revolutionize Personal Devices at CES 2024

During a keynote address at CES 2024, Qualcomm CEO Cristiano Amon spotlighted the transformative potential of generative AI, emphasizing that the technology is poised to take a significant leap forward by leveraging edge computing—particularly within consumer electronics. He likened the current state of generative AI to being in the second inning of a nine-inning game, highlighting the exciting advancements yet to come.

Amon explained that generative AI is evolving beyond cloud-based applications and becoming embedded within devices such as smartphones. This shift means that AI can operate directly on your device, continuously learning from your data to provide personalized assistance. "The AI is going to develop differently from the cloud and the devices," he stated, noting that while cloud-based models like ChatGPT don’t utilize personal context—such as user location or behavior—edge AI can offer tailored experiences by analyzing data generated on your device.

For instance, if you text a friend about meeting up, the AI could check your calendar and suggest nearby locations based on your previous visits, all without compromising the privacy of your personal information. Amon mentioned, “Everything that you type on your phone could be a query for the AI,” illustrating how this technology could seamlessly integrate into everyday communication.

He expressed enthusiasm for the potential of this pervasive AI assistant, indicating that the immediacy of responses, combined with localized data processing, would create a more personal and transformative user experience. With such advancements, your device is not just a tool but becomes an active partner in managing your day-to-day life.

Amon also highlighted Qualcomm's X Elite PC platform, which features the powerful Oryon CPU capable of running generative AI models with up to 13 billion parameters directly on the device. He announced that PCs equipped with this chip are expected to start shipping from manufacturers by mid-2024.

In partnership with Microsoft, Qualcomm aims to enhance the next-generation PC experience. Amon stated that X Elite PCs will be compatible with Microsoft’s generative AI assistant, Copilot, positioning these devices at the forefront of an evolving Windows environment. "As Windows changes to an AI and a Copilot experience, X Elite is the platform that is going to take that next-generation Windows experience to consumers," he explained.

The future of generative AI at the edge promises not only increased functionality but also a greater sense of privacy and personalization, making technology more attuned to individual user needs and preferences.