is_factually_consistent is being deprecated. Avoid using it for new integrations.
Use groundedness for new implementations.
What to do If you get Undesired Results
If the content is evaluated as factually inconsistent (Failed) and you want to improve it:
- Verify all facts against reliable sources or the provided context
- Remove any claims or details not supported by the source material
- Correct any inaccuracies, contradictions, or misrepresentations
- Ensure numbers, dates, names, and specific details align with the source
- Avoid extrapolating beyond what is explicitly stated in the source
- Use qualifying language (like “may,” “could,” or “suggests”) when appropriate
- Cite specific parts of the source material when providing information
Comparing Is Factually Consistent with Similar Evals
- Factual Accuracy: While Is Factually Consistent focuses on consistency with the provided input or context, Factual Accuracy might verify claims against broader world knowledge.
- Groundedness: Is Factually Consistent evaluates whether output contradicts the source, while Groundedness measures how well the output is supported by the source.