LLM Judge checks: Evaluate anything you can describe in words | Giskard Hub v.3.0

Giskard
50 views •

Some checks are trivial to script: the response is valid JSON, the amount matches, the field exists. Whether the answer stayed grounded in your knowledge base, or refused for the right reason, has no regex. Giskard Hub v3 hands those to an LLM judge you configure yourself. šŸŽÆ What's new: - LLM Judge check — Describe the pass condition in plain language. Craft your own prompt template and evaluate a single interaction or the full trace against it. - A full evaluator library — String matching, comparison, and structured or automated validation, for the assertions that don't need a model to decide. - Custom checks — Compose your own evaluators on top of the existing ones instead of maintaining test logic outside the platform. - Applies anywhere in the trace — Run any check on the final answer or at an intermediate step of a multi-turn conversation. šŸ“– Documentation: https://docs.giskard.ai/hub/ui šŸš€ Request a demo: https://www.giskard.ai/contact #AIsecurity #LLMEvaluation #LLMasaJudge #AIagents

Keyboard shortcuts

On. Switch them off if they collide with your assistive tools; ? still opens this sheet.

Go to

Press g then the letter.

  • gh Latest
  • gs Sources
  • gm Media
  • gv Videos
  • gp Podcasts
  • gc Calendar
  • gd Decoder
  • gz Dataviz
  • ga Datasets
  • gb Blog
  • gk Markets
  • gj Careers
  • gn Prompt Notebook

On this page

  • / Focus search, where there is one
  • t Back to top
  • ? This list
  • Esc Close