Assesses whether a response is firmly based on the provided context. This evaluation ensures that the response does not introduce information that is not supported by the context, thereby maintaining factual accuracy and relevance.
result = evaluator.evaluate( eval_templates="groundedness", inputs={ "input": "The Earth orbits around the Sun in how many days?", "context": "The Earth completes one orbit around the Sun every 365.25 days", "output": "365.25 days" }, model_name="turing_flash")print(result.eval_results[0].output)print(result.eval_results[0].reason)
import { Evaluator, Templates } from "@future-agi/ai-evaluation";const evaluator = new Evaluator();const result = await evaluator.evaluate( "groundedness", { input: "The Earth orbits around the Sun in how many days?", context: "The Earth completes one orbit around the Sun every 365.25 days", output: "365.25 days" }, { modelName: "turing_flash", });console.log(result);
Input
Required Input
Type
Description
output
string
The output generated by the model
context
string
The context provided to the model
Optional Input
input
string
The input provided to the model
Output
Field
Description
Result
Returns a score, where higher values indicate better grounding in the input
Reason
Provides a detailed explanation of the groundedness assessment
If the evaluation fails, the Context Review should reassess the provided context for completeness and clarity, ensuring it includes all necessary information to support the response. In Response Analysis, the response should be examined for any elements not supported by the context, and adjustments should be made to improve alignment with the given information.
While both evaluations assess context alignment, Groundedness ensures that the response is strictly based on the provided context, whereas Context Adherence measures how well the response stays within the context without introducing external information. Both evaluations require a response and context as inputs and produce a Pass/Fail output based on adherence to the provided information.