Skip to main content
POST
/
compare_prompts
Compare multiple prompts against a dataset
curl --request POST \
  --url https://beta.getplum.ai/v1/compare_prompts \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '{
  "system_prompts": [
    "<string>"
  ],
  "seed_data_id": "<string>",
  "synthetic_data_id": "<string>",
  "metrics_id": "<string>",
  "model_name": "<string>",
  "model_provider": "<string>"
}'
{
  "result": {
    "prompts": [
      "<string>"
    ],
    "comparisons": [
      {}
    ],
    "metrics_id": "<string>"
  }
}

Authorizations

Authorization
string
header
required

Body

application/json
system_prompts
string[]
required
model_name
string
required
model_provider
string
required
seed_data_id
string

ID of seed dataset to use (either this or synthetic_data_id is required)

synthetic_data_id
string

ID of synthetic dataset to use (either this or seed_data_id is required)

metrics_id
string

Response

200 - application/json

Prompts successfully compared

result
object
I