Jensen Huang: Analyzing the Future of AI 'Inference' Development and Cost Challenges in Computational Power

Home Hardware Jensen Huang: Analyzing the Future of AI 'Inference' Development and Cost Challenges in Computational Power

Updated on November 3 2024

The Relationship Between AI's Reasoning Abilities and the Cost of Computational Power

In a recent podcast, NVIDIA CEO Jensen Huang discussed the future of artificial intelligence with ARM CEO Rene Haas. Huang highlighted that the key to AI's potential lies in its ability to offer "reasoning" services. However, achieving this goal requires a significant reduction in the cost of computational power.

He explained that next-generation AI tools will respond to user queries through hundreds or thousands of steps, allowing them to reflect on their conclusions. This level of reasoning capability will differentiate future software from existing systems like ChatGPT. Huang shared that he personally uses ChatGPT daily.

Huang emphasized NVIDIA's commitment to improving chip performance by two to three times each year while keeping costs and energy consumption stable. This transformation is expected to significantly enhance AI systems' abilities in pattern recognition and conclusion drawing. He noted, "We can drastically lower the cost of achieving intelligence. The value of this advancement is clear; by reducing costs, we can enable breakthroughs in reasoning."

According to the latest report from Jon Peddie Research, global shipments of AIB graphics cards are projected to reach 9.5 million units by the second quarter of 2024, a 9.4% increase from the previous quarter and a 47.9% year-over-year growth. NVIDIA continues to dominate the market with an impressive 88% share.

OpenAI Asks Court to Dismiss Musk's Lawsuit, Calling it a Frivolous Harassment Tactic

OpenAI Projects Profit by 2029 Despite Anticipated $14 Billion Loss by 2026

Most people like

Affiliate Plus - Lasso

236.4K

Welcome to our AI-driven affiliate marketing platform, where innovation meets opportunity. Our cutting-edge technology empowers businesses and marketers to optimize their affiliate strategies, driving sales and boosting engagement. By harnessing the power of artificial intelligence, we analyze data in real-time, enabling targeted campaigns that convert. Whether you're a seasoned marketer or new to affiliate marketing, our platform offers the tools and insights you need to maximize your success in the digital marketplace. Discover how our AI-driven solutions can transform your affiliate marketing efforts today!

affiliate marketing AI Analytics Assistant

Lempod

38.4K

Unlocking the Power of AI: Enhance Your LinkedIn Engagement and Boost Post Visibility Effortlessly.

LinkedIn automation AI Social Media Assistant

Aidaptive

15.1K

Aidaptive leverages cutting-edge AI technology to boost conversions and increase revenue for eCommerce and hospitality brands.

eCommerce AI Other

PseudoEditor

38.9K

Introducing PseudoEditor, a free online editor designed to simplify the process of writing and editing pseudocode. With its intuitive interface and powerful features, PseudoEditor makes it easy for users of all skill levels to create clear and organized pseudocode efficiently.

pseudocode editor AI Developer Tools

Find AI tools in YBX