Outputs vs Behavior: Why AI Evals Rewarded Cheating

Fiddler AI
35 views •

When graders only check the final answer, an agent that steals the answer key gets full marks. Amit Paka, COO and Co-founder of Fiddler AI, explains why cheating showed up as a success metric, and why these failures came from missing telemetry and policy rather than exotic AI safety problems. Watch the full AI Explained session: https://www.fiddler.ai/webinars/ai-explained-agents-outgrew-safety-controls #Shorts #AIEvals #AIAgents #AIObservability

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close