Anthropic Launches Claude 3.5 Sonnet Model: Outperforming GPT-4o and Gemini 1.5 Pro

Home AI News Anthropic Launches Claude 3.5 Sonnet Model: Outperforming GPT-4o and Gemini 1.5 Pro

Updated on October 23 2024

Anthropic has announced the release of its latest models, Claude 3.5 Sonnet and Claude 3.5 Haiku. The upgraded Claude 3.5 Sonnet features significant improvements across various functionalities, especially in programming capabilities. Meanwhile, the Claude 3.5 Haiku model is designed as Anthropic's response to OpenAI's GPT-4o Mini and Google's Gemini 1.5 Flash. It maintains the same pricing as its predecessor while offering enhanced performance.

Improvements in Claude 3.5 Sonnet:

- SWE-bench Verification Score: Increased from 33.4% to 49.0%, setting a new industry benchmark.

- Retail Sector Performance: TAU-bench score improved from 62.6% to 69.2%.

- Aerospace Sector Performance: Increased from 36.0% to 46.0%.

- General Knowledge and Mastery: GPQA and MMLU Pro scores rose to 65% and 78%, surpassing those of Gemini 1.5 Pro.

The new Claude 3.5 Haiku model excels in various AI benchmark tests, outperforming its predecessor, Claude 3 Opus. On the SWE-bench Verified test, it achieved a score of 40.6%, exceeding both the original Claude 3.5 Sonnet and OpenAI’s GPT-4 Turbo. Initially, Claude 3.5 Haiku will be available in pure text format, with plans to support image formats in the future.

Anthropic highlights that the US Artificial Intelligence Safety Institute (US AISI) and the UK Artificial Intelligence Safety Institute (UK AISI) have conducted pre-deployment testing of the new Claude 3.5 Sonnet model, a collaboration stemming from an agreement signed earlier this year. In line with its responsible scaling policy, the updated Claude 3.5 Sonnet model adheres to ASL-2 standards.

The enhanced Claude 3.5 Sonnet is now available through the Anthropic API, Amazon Bedrock, and Google Cloud's Vertex AI at the same pricing as before. The new Claude 3.5 Haiku model is expected to launch later this month.

These latest Claude 3.5 models deliver superior performance at competitive prices, making them an appealing choice for developers and businesses seeking advanced language models for their AI applications.

Anthropic Unveils Claude 3.5 Sonnet: Can It Control Users' Computers? This refined title maintains the original meaning while enhancing clarity and engagement.

Claude 3.5 Sonnet Upgrade: Can AI Now Operate Computers Like Humans?

Most people like

Seaart.ai

Unlock the Power of AI-Generated Illustrations Discover the exciting world of AI illustration generation with our innovative platform. Here, creativity meets cutting-edge technology, allowing users to create stunning illustrations effortlessly. Whether you're a professional artist, a designer, or just someone looking to explore your artistic side, our AI-driven tools provide you with endless possibilities to bring your ideas to life. Join us today and transform the way you create visuals!

AI AI Anime Art

Voisi

Introducing a powerful Multi-AI toolkit designed for transforming voice and language. This innovative solution harnesses the latest advancements in artificial intelligence to enhance communication by seamlessly converting and optimizing vocal and textual content. Whether for personal use or professional applications, this toolkit offers unparalleled versatility in language and voice modifications.

AI voice toolkit Large Language Models (LLMs)

SuperStudentAI

Are you struggling to keep your study materials organized or looking for innovative ways to prepare for exams? Our AI study assistant is here to help! This intelligent tool not only organizes your study resources efficiently but also generates customized quizzes to reinforce your learning. Embrace a smarter way to study and enhance your exam performance with this cutting-edge AI solution.

AI study assistant AI Education Assistant

August Melon Technology

In today's competitive landscape, effective global patent retrieval and analysis play a crucial role in driving innovation and safeguarding intellectual property. By systematically gathering and examining patent data from around the world, businesses and researchers can identify trends, uncover competitive intelligence, and make informed decisions. This process not only enhances strategic planning but also fosters growth by keeping pace with technological advancements and market shifts. Join us as we explore the essential methods and tools for navigating the complexities of global patent information to empower your innovation strategy.

patent retrieval Other

Find AI tools in YBX