News
Amazon Bedrock Gets Anthropic's New Claude 3.7 Sonnet 'Most Intelligent' Hybrid Reasoning Model
AWS announced Anthropic's Claude 3.7 Sonnet is now available in Amazon Bedrock, providing what Anthropic claims is the first hybrid reasoning model on the market.
In the rapidly advancing GenAI space, "reasoning" is the ability for models to go beyond pattern matching and mimic human-like thought processes by executing tasks that require logical deduction, factual accuracy, and multi-step problem-solving. Instead of basic text prediction, reasoning allows models to solve problems, infer relationships, and make decisions based on structured thought processes.
The hybrid functionality allows users to toggle between fast response mode for quick answers and extended thinking mode for deeper, step-by-step analysis within a single AI model, optimizing both speed and accuracy based on task complexity.
"Claude 3.7 Sonnet introduces a unique approach to AI reasoning by integrating it seamlessly with other capabilities," AWS said in an announcement yesterday. "Unlike traditional models that separate quick responses from those requiring deeper thought, Claude 3.7 Sonnet allows users to toggle between standard and extended thinking modes. In standard mode, it functions as an upgraded version of Claude 3.5 Sonnet. While in extended thinking mode, it employs self-reflection to achieve improved results across a wide range of tasks. Amazon Bedrock users can adjust how long the model thinks, offering a flexible trade-off between speed and answer quality. Additionally, users can control the reasoning budget by specifying a token limit, enabling more precise management of cost."
Those capabilities were further explained in Anthropic's Feb. 24 announcement of the new model: "Today, we're announcing Claude 3.7 Sonnet, our most intelligent model to date and the first hybrid reasoning model on the market. Claude 3.7 Sonnet can produce near-instant responses or extended, step-by-step thinking that is made visible to the user. API users also have fine-grained control over how long the model can think for."
[Click on image for larger view.] Benchmarks (source: Anthropic).
AWS has partnered with Anthropic to the tune of $4 billion in funding, and its Bedrock service, offering models from different sources, was quick to host Claude 3.7 Sonnet, though it's also available via the Anthropic API and the Vertex AI service from fellow hyperscaler Google Cloud.
The new model was explored in depth in yet another AWS blog post, which detailed coding capabilities, a 15x longer output capacity than its predecessor, and an adjustable reasoning budget. Regarding the latter, AWS said, "You can control the budget for thinking when you use Claude 3.7 Sonnet in Amazon Bedrock. This flexibility helps you weigh the trade-offs between speed, cost, and performance. By allocating more tokens to reasoning for complex problems or limiting tokens for faster responses, you can optimize performance for your specific use case."
AWS further trumpeted its new offering on its "Anthropic's Claude in Amazon Bedrock" site, which lists use cases including coding, customer service, operations, legal and insurance. That site, along with exploring hybrid reasoning capabilities and the adjustable reasoning budget, also explains how the new model is optimized for real-world applications commonly encountered by users. "This pragmatic approach balances academic problem-solving with practical, everyday challenges," it said. "The broad range of applications suited for Claude 3.7 Sonnet makes it a versatile model that can address the diverse needs of customers across various industries and use cases."
About the Author
David Ramel is an editor and writer at Converge 360.