Skip to main content
result = evaluator.evaluate(
    eval_templates="is_polite",
    inputs={
        "output": "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
    },
    model_name="turing_flash"
)

print(result.eval_results[0].output)
print(result.eval_results[0].reason)
import { Evaluator, Templates } from "@future-agi/ai-evaluation";

const evaluator = new Evaluator();

const result = await evaluator.evaluate(
  "is_polite",
  {
    output: "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
  },
  {
    modelName: "turing_flash",
  }
);

console.log(result);
Input
Required InputTypeDescription
outputstringThe response to be evaluated for politeness.
Output
| | Field | Description | | | Result | Returns Passed if the response is polite and respectful, or Failed if it’s not. | | | Reason | Provides a detailed explanation of the evaluation. |

Troubleshooting

If you encounter issues with this evaluation:
  • Politeness standards can vary across cultures and contexts - the evaluation generally uses Western business communication norms
  • Short or technical communications might be neutral rather than explicitly polite
  • This evaluation focuses on the presence of polite elements and absence of impolite ones
  • Consider cultural context when interpreting results, as politeness norms vary globally
  • tone: Provides a broader assessment of communication style beyond just politeness
  • cultural-sensitivity: Evaluates awareness of and respect for diverse cultural norms
  • no-apologies: Specifically checks for unnecessary apologetic language
  • toxicity: Identifies hostile or offensive language (opposite of politeness)