Skip to main content
POST
/
compare_prompts
Compare multiple prompts against a dataset
curl --request POST \
  --url https://beta.getplum.ai/v1/compare_prompts \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "system_prompts": [
    "<string>"
  ],
  "model_name": "<string>",
  "model_provider": "<string>",
  "seed_data_id": "<string>",
  "synthetic_data_id": "<string>",
  "metrics_id": "<string>"
}
'
{
  "result": {
    "prompts": [
      "<string>"
    ],
    "comparisons": [
      {}
    ],
    "metrics_id": "<string>"
  }
}

Documentation Index

Fetch the complete documentation index at: https://docs.getplum.ai/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

​
Authorization
string
header
required

Body

application/json
​
system_prompts
string[]
required
​
model_name
string
required
​
model_provider
string
required
​
seed_data_id
string

ID of seed dataset to use (either this or synthetic_data_id is required)

​
synthetic_data_id
string

ID of synthetic dataset to use (either this or seed_data_id is required)

​
metrics_id
string

Response

200 - application/json

Prompts successfully compared

​
result
object