✨ Data quality: confusion matrix | API Reference

curl http://localhost:8000/api/projects/1/analytics/data-quality/agreement-analysis/confusion-matrix \
     -H "Authorization: Token  <api_key>" \
     -H "Content-Type: application/json"

{
  "labels": [
    "Cat",
    "Dog",
    "Rabbit"
  ],
  "matrix": [
    [
      45,
      3,
      2
    ],
    [
      4,
      50,
      1
    ],
    [
      1,
      2,
      40
    ]
  ],
  "precision": [
    0.9,
    0.91,
    0.93
  ],
  "recall": [
    0.88,
    0.92,
    0.89
  ],
  "top_confusion_pairs": [
    {
      "actual": "Cat",
      "count": 3,
      "label": "Dog",
      "rate": 0.05,
      "from_name": "label"
    },
    {
      "actual": "Dog",
      "count": 4,
      "label": "Cat",
      "rate": 0.06,
      "from_name": "label"
    }
  ]
}

This endpoint is not available in Label Studio Community Edition. Learn more about Label Studio Enterprise

Returns label confusion matrix with precision, recall, and top confusion pairs. In ground_truth mode the matrix is directional: rows are GT labels (actual), columns are annotator labels (predicted). In all and accepted modes — where no canonical “actual vs predicted” axis exists — the matrix is symmetric. When a task has multiple GT annotations the most recently updated one is used. top_confusion_pairs.rate is the share of off-diagonal mass.

<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Returns label confusion matrix with precision, recall, and top confusion pairs. In `ground_truth` mode the matrix is directional: rows are GT labels (actual), columns are annotator labels (predicted). In `all` and `accepted` modes — where no canonical "actual vs predicted" axis exists — the matrix is symmetric. When a task has multiple GT annotations the most recently updated one is used. `top_confusion_pairs.rate` is the share of off-diagonal mass.

Authentication

AuthorizationToken

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example:

curl https://label-studio-host/api/projects -H “Authorization: Token [your-token]”

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example: <br><pre><code class="language-bash">curl https://label-studio-host/api/projects -H "Authorization: Token [your-token]"</code></pre>

Path parameters

idintegerRequired

Query parameters

from_namestringOptionalDefaults to

From name

modeenumOptionalDefaults to all

Mode

Allowed values:

Response

labelslist of strings

matrixlist of lists of integers

precisionlist of doubles

recalllist of doubles

top_confusion_pairslist of objects