✨ Create Databricks import storage | API Reference

This endpoint is not available in Label Studio Community Edition. Learn more about Label Studio Enterprise

Create a Databricks Files import storage connection.

<Card href="https://humansignal.com/goenterprise"> <img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/> <p style="margin-top: 10px; font-size: 14px;"> This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise) </p> </Card> Create a Databricks Files import storage connection.

Authentication

AuthorizationToken

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example:

curl https://label-studio-host/api/projects -H “Authorization: Token [your-token]”

The token (or API key) must be passed as a request header. You can find your user token on the User Account page in Label Studio. Example: <br><pre><code class="language-bash">curl https://label-studio-host/api/projects -H "Authorization: Token [your-token]"</code></pre>

Request

This endpoint expects an object.

catalogstringRequired>=1 character

UC catalog name

hoststringRequired>=1 character

Databricks workspace base URL (https://…)

projectintegerRequired

A unique integer value identifying this project.

schemastringRequired>=1 character

UC schema name

volumestringRequired>=1 character

UC volume name

auth_typeenumOptional

Authentication method: PAT, Databricks SP, or Azure AD SP

pat - Personal Access Token
dbx_sp - Databricks Service Principal
azure_ad_sp - Azure AD Service Principal

Authentication method: PAT, Databricks SP, or Azure AD SP * `pat` - Personal Access Token * `dbx_sp` - Databricks Service Principal * `azure_ad_sp` - Azure AD Service Principal

Allowed values:

client_idstringOptional

Service principal client/application ID (required for SP modes)

client_secretstringOptional

Service principal client secret (required for SP modes)

descriptionstring or nullOptional

Cloud storage description

last_syncdatetime or nullOptional

Last sync finished time

last_sync_countinteger or nullOptional0-2147483647

Count of tasks synced last time

last_sync_jobstring or nullOptional<=256 characters

Last sync job ID

metaany or nullOptional

Meta and debug information about storage processes

prefixstring or nullOptional

Path under the volume

presignbooleanOptional

Presign not supported; always proxied

presign_ttlintegerOptional0-32767

Unused for Databricks; kept for compatibility

recursive_scanbooleanOptional

Perform recursive scan

regex_filterstring or nullOptional

Regex for filtering objects

request_timeout_sintegerOptional0-2147483647

statusenumOptional

initialized - Initialized
queued - Queued
in_progress - In progress
failed - Failed
completed - Completed
completed_with_errors - Completed with errors

* `initialized` - Initialized * `queued` - Queued * `in_progress` - In progress * `failed` - Failed * `completed` - Completed * `completed_with_errors` - Completed with errors

stream_chunk_bytesintegerOptional0-2147483647

synchronizablebooleanOptionalDefaults to true

tenant_idstringOptional

Azure AD tenant ID (required for Azure AD SP mode)

titlestring or nullOptional<=256 characters

Cloud storage title

tokenstringOptional

Databricks personal access token (required for PAT mode)

tracebackstring or nullOptional

Traceback report for the last failed sync

use_blob_urlsbooleanOptional

Generate blob URLs in tasks

verify_tlsbooleanOptional

Verify TLS certificates

Response

catalogstring

UC catalog name

created_atdatetimeRead-only

Creation time

hoststring

Databricks workspace base URL (https://…)

idintegerRead-only

projectinteger

A unique integer value identifying this project.

schemastring

UC schema name

typestringRead-onlyDefaults to databricks

volumestring

UC volume name

auth_typeenum

Authentication method: PAT, Databricks SP, or Azure AD SP

pat - Personal Access Token
dbx_sp - Databricks Service Principal
azure_ad_sp - Azure AD Service Principal

Authentication method: PAT, Databricks SP, or Azure AD SP * `pat` - Personal Access Token * `dbx_sp` - Databricks Service Principal * `azure_ad_sp` - Azure AD Service Principal

Allowed values:

client_idstring

Service principal client/application ID (required for SP modes)

descriptionstring or null

Cloud storage description

last_syncdatetime or null

Last sync finished time

last_sync_countinteger or null0-2147483647

Count of tasks synced last time

last_sync_jobstring or null<=256 characters

Last sync job ID

metaany or null

Meta and debug information about storage processes

prefixstring or null

Path under the volume

presignboolean

Presign not supported; always proxied

presign_ttlinteger0-32767

Unused for Databricks; kept for compatibility

recursive_scanboolean

Perform recursive scan

regex_filterstring or null

Regex for filtering objects

request_timeout_sinteger0-2147483647

statusenum

initialized - Initialized
queued - Queued
in_progress - In progress
failed - Failed
completed - Completed
completed_with_errors - Completed with errors

* `initialized` - Initialized * `queued` - Queued * `in_progress` - In progress * `failed` - Failed * `completed` - Completed * `completed_with_errors` - Completed with errors

stream_chunk_bytesinteger0-2147483647

synchronizablebooleanDefaults to true

tenant_idstring

Azure AD tenant ID (required for Azure AD SP mode)

titlestring or null<=256 characters

Cloud storage title

tracebackstring or null

Traceback report for the last failed sync

use_blob_urlsboolean

Generate blob URLs in tasks

verify_tlsboolean

Verify TLS certificates

1	curl -X POST http://localhost:8000/api/storages/databricks/ \
2	-H "Authorization: Token <api_key>" \
3	-H "Content-Type: application/json" \
4	-d '{
5	"catalog": "analytics_catalog",
6	"host": "https://adb-1234567890123456.7.azuredatabricks.net",
7	"project": 42,
8	"schema": "sales_schema",
9	"volume": "data_volume_01"
10	}'

1	{
2	"catalog": "analytics_catalog",
3	"created_at": "2024-01-15T09:30:00Z",
4	"host": "https://adb-1234567890123456.7.azuredatabricks.net",
5	"id": 42,
6	"project": 42,
7	"schema": "sales_schema",
8	"type": "databricks",
9	"volume": "data_volume_01",
10	"auth_type": "pat",
11	"client_id": "sp-client-9876543210",
12	"description": "Databricks storage for sales data import",
13	"last_sync": "2024-04-20T14:45:00Z",
14	"last_sync_count": 1500,
15	"last_sync_job": "sync-job-20240420-1445",
16	"prefix": "imports/sales",
17	"presign": false,
18	"presign_ttl": 0,
19	"recursive_scan": true,
20	"regex_filter": "^.*\\.csv$",
21	"request_timeout_s": 120,
22	"status": "completed",
23	"stream_chunk_bytes": 1048576,
24	"synchronizable": true,
25	"tenant_id": "72f988bf-86f1-41af-91ab-2d7cd011db47",
26	"title": "Sales Data Databricks Storage",
27	"traceback": "",
28	"use_blob_urls": false,
29	"verify_tls": true
30	}