Experiments in Dataset

To test, validate, and compare different prompt configurations

1. Navigate to the Experiments

   Click on the “Experiments” button in the top-right corner on the dataset dashboard.

   
2. Create a new experiment

   Provide a name for the experiment and select which column you want to compare your generated responses with.

   
3. Prompt Template

   Create a prompt in this section and generate responses for the experiment.

   

   Choose the model you want to use for the experiment. You can choose as many models you want to compare. You can even create a custom model by clicking on the “Create Custom Model” button.

   Click here to learn how to create a custom model.

   

   You can use the existing prompt template or generate a new one from scratch.

   Click here to learn more about prompts.

   You can create as many prompt templates here

4. Choosing Evals

   Main purpose of an experiment is to compare the combination of prompt and model performance. So, you need to choose the evals you want to run on the generated responses.

   

   Click on “Add Evaluation” and select evals from existing eval templates or create a new eval from scratch.

   

   You can create as many evals here as you want to compare.

5. Run Experiment

   After you have configured the prompts, selected the models and evals, click on “Run” to start the experiment.