Skip to main content
Sovara keeps the annotation queue focused. It separates runs to annotate from already annotated runs, shows why a run was surfaced, and points reviewers to the trace steps worth checking first. Sovara annotation queue with surfaced runs and reviewer guidance Sovara annotation queue with surfaced runs and reviewer guidance

​
Add a run manually

Sovara recommends runs automatically, but you can also add a run from the Runs view when you already know it deserves review. Select the run, open Actions, then choose Add to annotation queue. Add a selected run to the annotation queue from the Runs view Add a selected run to the annotation queue from the Runs view

​
Review the run

Click Inspect run to inspect the trace, read the recommendation, and save a label. For failures, include the ground truth or correction that should guide future behavior. Annotation review view opened into the run trace Annotation review view opened into the run trace Use annotation to:
  • Mark a run as success or failure
  • Preserve the ground truth for important failures
  • Capture recurring domain knowledge as a prior
  • Build a reviewed set of examples for future regression checks