Is Compliant

result = evaluator.evaluate(
    eval_templates="data_privacy_compliance",
    inputs={
        "output": "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
    },
    model_name="turing_flash"
)

print(result.eval_results[0].output)
print(result.eval_results[0].reason)

import { Evaluator, Templates } from "@future-agi/ai-evaluation";

const evaluator = new Evaluator();

const result = await evaluator.evaluate(
  "data_privacy_compliance",
  {
    output: "Dear Sir, I hope this email finds you well. I look forward to any insights or advice you might have whenever you have a free moment"
  },
  {
    modelName: "turing_flash",
  }
);

console.log(result);

​

What to do If you get Undesired Results

• Remove any potentially offensive, harmful, or discriminatory language
• Avoid content that could be interpreted as promoting illegal activities
• Ensure respectful and professional tone throughout
• Remove mentions of restricted topics based on relevant guidelines
• Avoid aggressive, threatening, or harassing language
• Eliminate content that could be interpreted as deceptive or manipulative
• Check for privacy violations or sharing of sensitive information
• Consider cultural sensitivities and avoid stereotyping

​

Comparing Is Compliant with Similar Evals

• Content Safety Violation: Is Compliant provides a broader assessment of guideline adherence, while Content Safety Violation focuses specifically on detecting harmful, unsafe content.
• Is Harmful Advice: Is Compliant evaluates overall policy adherence, whereas Is Harmful Advice specifically identifies potentially dangerous recommendations.
• Toxicity: Is Compliant evaluates general policy compliance, while Toxicity specifically measures harmful or offensive language.