✨ Get task agreement matrix

<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Returns a pairwise agreement matrix between selected participants for a single task, averaged across all active dimensions or a single specified dimension.

Authentication

AuthorizationToken
The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example: <br><pre><code class="language-bash">curl https://label-studio-host/api/projects -H "Authorization: Token [your-token]"</code></pre>

Path parameters

project_pkintegerRequired
Project ID
task_pkintegerRequired
Task ID

Query parameters

dimensionintegerOptional
Dimension ID to compute agreement for. If not provided, averages across all active dimensions.
selectionobjectRequired
JSON object specifying which participants to include in the agreement matrix

Response

matrixlist of lists of doubles

Pairwise agreement scores matrix where matrix[i][j] is the agreement between users[i] and users[j]

userslist of maps from strings to any

Expanded participant details (annotators and/or model versions)