Skip to content

Sidra Data & AI Platform

Databricks

Initializing search

Getting Started
Sidra
Services
Sidra Web
Data Products
Guides
Release Notes

Sidra Data & AI Platform

Getting Started
Getting Started
Sidra
Sidra
- How Does Sidra Work
- Quick Start
- Concepts
  Concepts
- Data Ingestion
  Data Ingestion
  - Overview
  - Data Intake Mechanisms
  - Data Intake Types
    Data Intake Types
    
    Data Intake via Landing Zone
    Data Intake via Landing Zone
    
    Configuration Steps
    
    Data Intake with Document Indexing
    Data Intake with Document Indexing
    
    Configuration Steps
    
    Knowledge Store Ingestion Script
    
    DI Indexing Concepts
    
    Data Intake Process
    Data Intake Process
    
    Overview
    
    Configuration Steps
    
    Schema Evolution
    
    Data Sync Mechanisms
  - ADF Ingestion Pipelines
  - DSU Ingestion
  - Table Creation
Services
Services
- Overview
- Services
- Supervisor
  Supervisor
  - Overview
  - Supervisor API
    Supervisor API
    
    Installation
    
    Plugin
    
    Infrastructure
    
    Services
- Sidra Core
  Sidra Core
  - Overview
  - Metadata
    Metadata
    
    Overview
    
    Data Ingestion
    Data Ingestion
    
    Overview
    
    Data Intake
    Data Intake
    
    Data Ingestion Hierarchy
    
    Data Source
    Data Source
    
    Data Source Tables
    Data Source Tables
    
    DataSource Table
    
    DataSourceTemplate Table
    
    DataSourceTemplatePipelineTemplate Table
    
    Provider
    Provider
    
    Provider Tables
    Provider Tables
    
    Provider Table
    
    ProviderTag Table
    
    Entity
    Entity
    
    Entity Overview
    
    Entity Tables
    Entity Tables
    
    Entity Table
    
    EntityEntity Table
    
    EntityDeltaLoad Table
    
    EntityPipeline Table
    
    EntityTag Table
    
    Entity Configuration
    Entity Configuration
    
    AdditionalProperties Configuration
    
    GenerateDeltaTable Configuration
    
    Attribute
    Attribute
    
    Attribute Tables
    Attribute Tables
    
    Attribute Table
    
    AttributeTag Table
    
    TypeTranslation Table
    
    Asset
    Asset
    
    Asset Overview
    
    Asset Tables
    Asset Tables
    
    Asset Table
    
    AssetAdditionalProperties Table
    
    AssetIndexingStatus Table
    
    AssetPart Table
    
    AssetStatus Table
    
    Other Tables
    Other Tables
    
    DataIntakeProcess Table
    
    Tag Table
    
    TagType Table
    
    TableFormat Table
    
    DataArchivalRule Table
    
    LoadRestrictionMode Table
    
    Azure Data Factory
    Azure Data Factory
    
    Overview
    
    Generic Artifacts
    
    Configure Linked Services - Data Source
    
    Component Templates
    
    ADF Tables
    ADF Tables
    
    Data Factory Table
    
    ADF Triggers Tables
    ADF Triggers Tables
    
    Triggers Overview
    
    TriggerTemplate Table
    
    Trigger Table
    
    TriggerPlatform Table
    
    TriggerPipeline Table
    
    ADF DatasetTemplate Table
    
    ADF ActivityTemplate Table
    
    ADF Pipelines Tables
    ADF Pipelines Tables
    
    ADF Pipelines Overview
    
    PipelineTemplate Table
    
    PipelineExecution Table
    
    PipelineTemplatePlatform Table
    
    PipelineTemplateType Table
    
    DatasetTemplatePipelineTemplate Table
    
    EntityPipeline Table
    
    Pipeline Table
    
    PipelineLoadRestriction Table
    
    PipelineLoadRestrictionObject Table
    
    PipelineLoadRestrictionMode Table
    
    Data Storage Unit
    Data Storage Unit
    
    DSU Tables
    DSU Tables
    
    DataStorageUnit Table
    
    ClusterType Table
    
    Storage Table
    
    StorageRole Table
    
    LandingZone Table
    
    Apps
    Apps
    
    App Table
    
    AppTags Table
    
    AppTag Table
    
    Data Catalog
    Data Catalog
    
    Data Catalog Tables
    Data Catalog Tables
    
    AttributePopularity Table
    
    DataPreviewLoadHistory Table
    
    Management
    Management
    
    Management Tables
    Management Tables
    
    Configuration Table
    
    AzureRegion Table
    
    ImportExportTask Table
    
    Notifications
    Notifications
    
    Notification Tables
    Notification Tables
    
    Notification Table
    
    NotificationRead Table
  - Sidra API
    Sidra API
    
    Overview
    
    Data Intake
    Data Intake
    
    Data Source
    
    Plugin
    
    Data Intake Process
    
    Provider
    
    Entity
    
    Asset
    
    PII Detection
    
    Attributes
    
    Tags
    
    Pipelines
    
    Azure Search
    
    Data Factory
    Data Factory
    
    Activity Templates
    
    Data Factory
    
    Dataset Templates
    
    Pipelines
    
    Triggers
    
    Data Storage Unit
    Data Storage Unit
    
    Cluster Types
    
    Data Storage Unit
    
    Databricks
    
    Landing Zone
    
    Search Services
    
    Storages
    
    Storage Roles
    
    Management
    Management
    
    Application
    
    Configuration
    
    Data Factory Metrics
    
    Installation
    
    Image
    
    Logs
    
    Notifications
    
    Service
    
    Type Translation
    
    Permissions
    
    Release Notes
    
    Identity
    Identity
    
    Identity Server User
    
    Ingestion
    Ingestion
    
    Inference
    
    Ingestion
    
    Data Querying
    Data Querying
    
    Query
- Authentication
  Authentication
  - Overview
- Authorization
  Authorization
  - Overview
  - Roles
  - Metadata
    Metadata
    
    Overview
    
    IdentityAccess Table
    
    IntegrationHubAccess Table
- Data Quality
  Data Quality
  - Overview
  - Manage via Sidra Web UI
  - Available Expectations
  - Validation Metadata
  - Roles and Security
  - Data Quality API
    Data Quality API
    
    Validations
    Validations
    
    Expectations
    
    Suites
    
    Reports
    
    Results
    
    Metadata
    Metadata
    
    Providers
    
    Entities
    
    Management
    Management
    
    DSU
    
    Check Processes
    
    Permissions
    
    Settings
- API Builder
  API Builder
  - Overview
  - Tutorials
    Tutorials
    
    Create APIs for a Data Product
- Data Catalog
  Data Catalog
  - Overview
- Integration Hub
  Integration Hub
  - Overview
  - Configuration
  - Monitoring
  - Integration Hub API
    Integration Hub API
    
    Topics
Sidra Web
Sidra Web
Data Products
Data Products
- Sidra Data Products
- Data Product Templates
  Data Product Templates
  - Data Domain
- Data Products Concepts
  Data Products Concepts
- Data Product API
  Data Product API
  - Overview
  - Data Extraction
  - Data Factory
  - Pipeline
  - Sync
  - Validation
  - Tabular
  - Power BI
  - Search Services
  - Management
Guides
Guides
- Deployment
  Deployment
- Data Intake
  Data Intake
- Metadata
  Metadata
- DSU
  DSU
  - Deploy an Additional DSU
  - Deploy a Fabric/OneLake DSU
- Sidra Data Product
  Sidra Data Product
- Management
  Management
Release Notes
Release Notes

Databricks¶

≥ 2022.R3

A Databricks endpoint has been enabled in order to add notebooks in Databricks.

2025-04-25

Data Storage Unit

Made with Material for MkDocs