✨ Get prediction agreement statistics for multiple annotators | API Reference

This endpoint is not available in Label Studio Community Edition. Learn more about Label Studio Enterprise

Get prediction agreement statistics for multiple annotators within a project.

<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Get prediction agreement statistics for multiple annotators within a project.

Authentication

AuthorizationToken

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example:

curl https://label-studio-host/api/projects -H “Authorization: Token [your-token]”

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example: <br><pre><code class="language-bash">curl https://label-studio-host/api/projects -H "Authorization: Token [your-token]"</code></pre>

Path parameters

idintegerRequired

Query parameters

idsstringRequired

Comma separated list of annotator user IDs to get agreement scores for

per_labelbooleanOptionalDefaults to false

Per label

Response

Prediction agreement statistics for multiple annotators

agreementmap from strings to doubles or maps from strings to doubles or null

Dictionary mapping user IDs to their prediction agreement scores

1	from label_studio_sdk import LabelStudio
2
3	client = LabelStudio(
4	api_key="YOUR_API_KEY_HERE"
5	)
6
7	client.projects.stats.users_prediction_agreement(
8	id=1,
9	ids="42,57,89",
10	per_label=False
11	)

1	{
2	"agreement": {
3	"42": 0.87,
4	"57": 0.91,
5	"89": 0.78
6	}
7	}