Optimize Your Prompts with Amazon Bedrock

AWS Developers
1,351 views โ€ข

Every token in your prompt costs money, and if a prompt runs thousands of times a day, a sloppy one adds up fast. Amazon Bedrock prompt optimization rewrites your prompts for a specific model so you get better output in fewer total tokens. Amazon Bedrock has a built-in tool that rewrites your prompts for you. Prompt optimization comes in two versions. Simple optimization is one click on the magic wand: you get a side-by-side of your original prompt and an optimized one for the model you picked, in seconds. Advanced optimization runs an asynchronous job: you give it a prompt template, example inputs, ground truth, and an evaluation method, and Bedrock tests the prompt across up to five models, scores the responses, and keeps rewriting until quality improves. Prompt optimization: Simple prompt optimization (the wand button): https://go.aws/48m0SYh Advanced Prompt Optimization, including model migration: https://go.aws/4yNb1rO Advanced Prompt Optimization launch blog: https://go.aws/3WUlN25 Prompt Management: Prompt Management overview: https://go.aws/4BF4fHw Versioning prompts for your application: https://go.aws/4ilxHsZ GetPrompt API, for fetching a saved prompt in code: https://go.aws/3UXymcq Measuring the saving: Model invocation logging, to track token usage: https://go.aws/47PDIcE Amazon Bedrock pricing: https://go.aws/48pz0T6 Follow AWS Developers! ๐Ÿ†‡ X: https://go.aws/47aKucD ๐Ÿ’ผ LinkedIn: https://go.aws/4iaaivF 0:00 Every Token in Your Prompt Costs Money 0:33 What Is a Prompt? (The Coffee Order) 1:35 Bedrock Prompt Optimization: Simple vs Advanced 2:24 4 Reasons to Optimize Your Prompts 3:57 Limits to Know Before You Start 4:55 Demo: Simple Optimization in the Playground 5:53 Longer Prompt, Lower Total Cost 6:37 Demo: Prompt Management & Versioning 8:53 Demo: Optimizing Prompts with the API (CI/CD) 10:08 When You Need Advanced Optimization 11:01 Demo: Advanced Optimization Across Models 12:51 Recap #AWS #AmazonBedrock #PromptOptimization #AI #LLM

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close