Skip to main content

Troubleshooting

If you encounter issues with this evaluation:
  • Remember that conciseness depends on context - what’s concise for a complex topic might still be relatively lengthy
  • This evaluation works best on complete responses rather than fragments
  • Very short responses may be marked as concise but might fail other evaluations like completeness
  • Consider the balance between conciseness and adequate information - extremely brief responses might miss important details
  • completeness: Ensures that despite being concise, the response addresses all aspects of a query
  • is-helpful: Evaluates if the response is actually useful despite its brevity
  • instruction-adherence: Checks if the response follows instructions, which might include requirements for detail
  • length-evals: Provides quantitative metrics about text length