Skip to content

Trace / Prompt / Experiments

Compliance is integrated into existing product surfaces so teams can debug quality and policy together.

Trace Compliance Panel

Trace details include a dedicated compliance panel with:

  • Current verdict and counts (PASS, FAIL, WARN, SKIP)
  • Per-rule results with severity and check type
  • Rule-level detail payloads
  • Latest audit hash
  • Latest reviewer status
  • Manual Run Evaluation / Re-run controls

If active rules changed after the last evaluation, the trace panel marks the result as outdated.

Prompt Version Compliance

Prompt detail pages include a Compliance by Prompt Version view that shows:

  • Total traces per prompt version
  • Evaluated trace count
  • Compliance rate by version
  • Breakdown across COMPLIANT, PROCESS_FAILURE, and NEEDS_REVIEW

Experiment Run Compliance

Dataset run comparison includes Experiment Compliance Comparison, showing compliance metrics per run ID:

  • Total traces per run
  • Evaluated trace count
  • Compliance rate
  • Verdict distribution

This lets teams compare output quality and compliance posture in the same experiment workflow.