What to do If you get Undesired Results
If the content is evaluated as factually inconsistent (Failed) and you want to improve it:- Verify all facts against reliable sources or the provided context
- Remove any claims or details not supported by the source material
- Correct any inaccuracies, contradictions, or misrepresentations
- Ensure numbers, dates, names, and specific details align with the source
- Avoid extrapolating beyond what is explicitly stated in the source
- Use qualifying language (like “may,” “could,” or “suggests”) when appropriate
- Cite specific parts of the source material when providing information
Comparing Is Factually Consistent with Similar Evals
- Factual Accuracy: While Is Factually Consistent focuses on consistency with the provided input or context, Factual Accuracy might verify claims against broader world knowledge.
- Groundedness: Is Factually Consistent evaluates whether output contradicts the source, while Groundedness measures how well the output is supported by the source.