At its re:Invent conference in Las Vegas, AWS on Wednesday announced both of these features for its Bedrock LLM hosting service. The other major new feature is intelligent prompt routing for Bedrock.

AWS brings prompt routing and caching to its Bedrock LLM service. Story by Frederic Lardinois • 3mo. A s businesses move from trying out generative AI in limited prototypes to putting them into ...