Presented by Nvidia
Nvidia made a significant impact at its annual GTC 2024 conference, unveiling groundbreaking advancements in AI technology. Our media team was fully engaged, offering comprehensive coverage and behind-the-scenes access to key industry figures. Over four days, the VB editorial crew conducted 21 live interviews from the show floor, all supported by Nvidia’s partnership with VB Lab.
If you missed it, here are some key highlights from the GTC 2024 interview series (catch all of VB’s video coverage here).
The Future of AI Factories
In an insightful conversation with senior writer Sharon Goldman, representatives from Nvidia, Deloitte, and Sustainable Metal Cloud discussed the transformation of GPU-based data centers—referred to as AI factories by Nvidia CEO Jensen Huang. Rohit Tandon, AI General Manager at Deloitte, emphasized that harnessing GPU power extends beyond the chip; it encompasses the entire infrastructure.
“It’s like having the best engine but needing to build the right car and have a skilled driver,” Tandon explained. “The vision of the Gen AI AI factory includes solid infrastructure, enablement, networking, software optimization, and the talent to drive it effectively.”
More Cost-Effective AI Models
VB lead writer Dean Takahashi interviewed Dan Diasio, the Global AI Consulting Leader at Ernst and Young (EY), about the firm’s approach to developing AI-driven businesses. EY introduced the MIN framework—Minimum Intelligence Necessary—for clients to innovate without relying on expensive frontier AI models.
“Not every organization needs an F1 car for everyday travel,” stated Diasio. “Many can achieve similar results using smaller, fine-tuned models customized with their expertise.”
The Building Blocks of Gen AI
Microsoft’s long-standing partnership with OpenAI has enabled the creation of advanced supercomputers vital for launching ChatGPT. Nidhi Chappell, General Manager of Azure Generative AI and HPC, affirmed Microsoft’s crucial role in shaping the Gen AI market. The collaboration continues with Nvidia, leveraging the Azure OpenAI service as foundational elements for clients to scale AI deployments.
“In my customer meetings, I’m continually amazed at the innovations stemming from these building blocks,” said Chappell. “Clients are applying language models in diverse ways—optimizing production processes and enhancing employee efficiency, among others.”
Taking AI into Production
Run:ai, a middleware solution provider, helps organizations effectively harness computing power for AI model construction. Companies like Adobe accelerated their AI implementations using Run:ai's platform. During the conference, CEO Omri Geller noted a growing trend among companies focused on building solid AI infrastructures.
“They’re increasingly prioritizing how to build AI properly to swiftly and efficiently deploy models in production,” Geller explained. “These conversations span end customers to our partners working with Run:ai on production clusters.”
Simplifying AI Adoption
Understanding the challenges enterprises face when adopting AI, Dell Technologies created an “easy button.” At GTC, they announced the Dell AI Factory with Nvidia, an end-to-end solution designed to streamline and expedite AI integration. Varun Chhabra, Dell SVP of Product Marketing, stated that organizations can tailor solutions to their specific needs.
“The excitement is palpable. This is the year for enterprise AI adoption,” Chhabra said. “While cloud providers are initiating POCs, we anticipate broader enterprise integration this year.”
Using AI on the Far Edge
Due to over $2 billion invested in AI and a solid partnership with Nvidia, Lenovo now ranks as the third-largest AI infrastructure provider globally. The company is particularly focused on edge AI through its ThinkEdge product line. Examples include automated self-checkout stations at Kroger and kiosks in Barcelona designed to detect car accidents.
“These applications extend well beyond factory settings to retail and even aiding major fast-food chains in automating drive-throughs,” said Kirk Skaugen, EVP and President of Lenovo’s Infrastructure Solutions Group. “It’s been an extraordinary year for edge computing.”
Catch up with all the VB interviews from GTC 2024 right here.
VB Lab Insights are created in collaboration with companies that sponsor posts or have business relationships with media outlets, always clearly marked.
Ranking
