A year after the initial announcement of Amazon Bedrock, AWS is rolling out significant updates to its generative AI platform, enhancing both model offerings and security measures.
Amazon Bedrock Overview
Launched in general availability in September 2023 after a preview in April 2023, Amazon Bedrock simplifies the development and deployment of generative AI models. The platform provides easy access to foundation models from renowned vendors such as Anthropic, Stability AI, Cohere, Meta, and A121, in addition to its proprietary Amazon Titan models.
Key Updates: Expanded Model Capabilities
With this update, AWS now allows developers to import their own models into Amazon Bedrock, a feature not previously available. Vasi Philomin, VP and GM of Generative AI at AWS, explained that many organizations, particularly in sectors like fintech and healthcare, may have already developed custom AI models or utilized the Amazon SageMaker platform.
“They can now bring those models to Amazon Bedrock, allowing them to operate alongside existing models in a completely serverless environment,” Philomin noted. This feature enables users to compare their models and apply them across various workflows seamlessly.
New Model Evaluation Service
The update also includes the general availability of the Model Evaluation service, which allows users to assess the performance of different models for specific applications. Customers can perform automated evaluations by selecting models and providing prompts related to their use cases, while human evaluations can rank model outputs side-by-side to identify the best-performing options. This dual evaluation process ensures that organizations choose the most suitable models for their needs.
Amazon Titan Text Embeddings v2 and Image Generator
Central to AWS's generative AI strategy is the Amazon Titan family of models. The recently launched Amazon Titan Text Embedding V2 serves as a foundational model for vector database searches, significantly improving data storage efficiency without sacrificing accuracy. This new model claims to reduce vector embedding storage requirements by up to four times.
Additionally, the Amazon Titan Image Generator, initially previewed in November 2023, is now available for businesses. Unlike general-purpose image generators, this tool focuses on solving specific business challenges, primarily in advertising, media, and entertainment, enabling highly realistic studio-quality image generation.
Enhanced Security with Guardrails for Amazon Bedrock
To bolster security in generative AI applications, AWS is introducing Guardrails for Amazon Bedrock. This feature enables users to implement natural language policies to ensure model safety. Users can establish rules to prevent harm by blocking discussions of sensitive topics and managing the risk of generating inappropriate content. According to AWS, applying these guardrails can enhance the detection and filtering of harmful content by up to 85% beyond built-in safeguards.
Looking Ahead
Philomin emphasizes that there is still much work to be done to enhance Amazon Bedrock further, particularly in developing additional workflows to facilitate application building for users.
In summary, the latest updates to Amazon Bedrock position AWS as a competitive player in the generative AI landscape, providing developers with more tools and resources to create effective AI applications while ensuring safety and compliance.