List all seed datasets

Retrieve a specific seed dataset by ID

Insert or overwrite seed data by ID

Add a single pair to a dataset (creates new dataset if the system_prompt_template that's provided doesn't correspond to an existing dataset)

Add a single pair to an existing seed dataset by ID

Upload a new seed dataset

List all synthetic datasets

Retrieve synthetic data by ID

Insert or overwrite synthetic data by ID

Upload new synthetic data

Get a specific metric definition by ID

Get a specific evaluation result by ID

Export evaluation results as TSV file

Update evaluation result with human feedback

Generate evaluation metrics

List all available evaluation metrics

List all available evaluation results

Create custom metric definitions

Evaluate datasets with specified metrics

Augment seed data to generate synthetic data

Gather high-scoring and positively critiqued pairs from evaluation results

Gather high-scoring and positively critiqued pairs formatted for OpenAI fine-tuning

Compare multiple prompts against a dataset

Generate an improved prompt based on comparison results