API ReferenceProjectsStats

✨ Get Inter-Annotator Agreement matrix

<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Get Inter-Annotator Agreement (IAA) matrix for a project, showing agreement between all annotators.

Authentication

AuthorizationToken
The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example: <br><pre><code class="language-bash">curl https://label-studio-host/api/projects -H "Authorization: Token [your-token]"</code></pre>

Path parameters

idintegerRequired

Query parameters

expandstringOptional

Comma-separated list of fields to expand

per_labelbooleanOptionalDefaults to false
Calculate IAA per label
stdbooleanOptionalDefaults to false
Include standard deviation in results
taskstringOptional

Comma-separated list of task IDs to filter by

Response

Inter-Annotator Agreement matrix

IAAlist of lists of doubles or map from strings to lists of lists of doubles

Inter-Annotator Agreement matrix - 2D array when per_label=false, object with label keys when per_label=true

common_taskslist of lists of doubles or map from strings to lists of lists of doubles

Common tasks matrix - 2D array when per_label=false, object with label keys when per_label=true

stddouble or map from strings to doubles

Standard deviation - number when per_label=false, object with label keys when per_label=true

userslist of objects
List of users in the matrix