Skip to navigation
API ReferenceProjectsStats

✨ Get prediction agreement statistics for multiple annotators

Label Studio Enterprise badge

This endpoint is not available in Label Studio Community Edition. Learn more about Label Studio Enterprise

Get prediction agreement statistics for multiple annotators within a project.

Authentication

AuthorizationToken

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example: 

curl https://label-studio-host/api/projects -H “Authorization: Token [your-token]”

Path parameters

idintegerRequired

Query parameters

idsstringRequired
Comma separated list of annotator user IDs to get agreement scores for
per_labelbooleanOptionalDefaults to false
Per label

Response

Prediction agreement statistics for multiple annotators
agreementmap from strings to doubles or maps from strings to doublesOptional
Dictionary mapping user IDs to their prediction agreement scores