Google's Upcoming A3 Supercomputer Featuring Nvidia H100 GPUs Set for General Availability Next Month

Home AI News Google's Upcoming A3 Supercomputer Featuring Nvidia H100 GPUs Set for General Availability Next Month

Updated on October 24 2024

Despite their steep price of over $30,000, Nvidia’s H100 GPUs are in high demand and often back-ordered. Earlier this year, Google Cloud introduced a private preview of its A3 GPU virtual machines powered by H100 chips, integrated with Google’s advanced 200 Gbps Infrastructure Processing Units (IPUs). Now, at its Cloud Next conference, Google has announced that the A3 will be available to the public next month.

It remains to be seen if Google Cloud can meet the demand for these powerful chips, especially as they are tailored for training and deploying generative AI models and large language models.

When Google Cloud unveiled the A3 last year, it highlighted its capability of delivering up to 26 exaflops of AI performance. Thanks to the custom IPUs, the A3 offers up to 10 times more network bandwidth than the previous-generation A2 machines.

“A3 is specifically designed to train, fine-tune, and serve highly demanding and scalable generative AI workloads and large language models,” said Mark Lohmeyer, VP and GM of computer and machine learning infrastructure at Google Cloud, in a press conference prior to today’s announcement. “It incorporates a variety of unique Google innovations, including our networking technologies and infrastructure processing, which are essential to supporting the immense scale and performance required for these tasks.”

Unlocking Google’s Duet AI: Your Ultimate Meeting Assistant, Document Summarizer, and Chat Companion

Google Enhances Vertex AI to Stay Ahead in the Generative AI Revolution

Most people like

Revisely

943.7K

Unlock the potential of AI-driven educational tools designed for both students and professionals. Discover how these innovative resources can enhance learning experiences and streamline skill development, making education more accessible and effective than ever before.

AI-powered learning AI Quizzes

Perchance AI

11.6M

Discover an innovative platform designed to create random generators effortlessly. This versatile tool allows users to design custom generators for a wide range of applications, from games and decision-making to brainstorming and creative storytelling. Whether you’re a developer, educator, or a creative enthusiast, this platform empowers you to whip up original randomization solutions that engage and inspire. Unlock your creativity today with the ultimate randomness generator creation platform!

Random Generator AI Tutorial

Saara Inc

65.1K

Saara is an innovative AI software designed to enhance returns management and boost customer satisfaction in the e-commerce sector. By streamlining processes and providing intelligent insights, Saara empowers online retailers to optimize their returns strategy, ensuring a seamless shopping experience for their customers.

AI-powered software AI Consulting Assistant

Flux AI Studio

109.4K

Discover our AI-powered platform that transforms your text into stunning images. With advanced technology, you can effortlessly bring your words to life—creating visuals to match your imagination. Join countless users who have unlocked the potential of turning ideas into captivating graphics using our innovative tools.

AI image generator Text to Image

Find AI tools in YBX