Skip to content

Deploy a Data Product

Deploying a Data Product in Sidra requires integration with the platform’s Virtual Network (VNet) to ensure secure, connected operation within your infrastructure.

The steps required vary depending on whether Sidra was installed using its default VNet configuration or integrated into an existing external VNet.

  • If using an external VNet, you must first configure subnets for Databricks:

Configure Subnets

  • If using the default VNet, you can skip that step and move on to:

Create a Data Domain

Info

For a conceptual overview of what a Data Domain is, see the Data Domain template page.

Configure Subnets in an Existing Sidra VNet

In a Sidra deployment, the primary resource group includes a Virtual Network (VNet) named using the format:

<deploymentPrefix>-<environmentId>-vnet (e.g., sds-test-vnet).

In the VNet’s Subnets section, create two new subnets:

Subnet Configuration

Required Subnets for Databricks

Create two subnets:

  • Private subnet: e.g., <dataproductname>_databricks_cluster
  • Public subnet: e.g., <dataproductname>_databricks_host

Configuration requirements:

  1. Service Endpoints:

    • Microsoft.KeyVault
    • Microsoft.Storage

  2. Subnet Delegation:

    • Microsoft.Databricks/workspaces

Associate Subnets with Sidra NSGs

Navigate to each Network Security Group (NSG) in Azure, go to Settings > Subnets, and associate your new subnets:

Associate NSG

Subnet Confirmation

Review Existing Subnets

Other resources in the Data Product will connect via existing subnets deployed by Sidra.

Info

For more details, refer to the Sidra Deployment Guide – Step 3: Supervisor ARM Template

Create a Data Domain

To deploy a Data Product of type Data Domain:

  1. In Sidra Web, go to the Data Products section and click New Data Product.

    Create Data Domain

  2. Fill in the required configuration fields:

Field Description Required
Data Product name Name for the Data Product. Must be between 1 and 15 characters. Yes
Description Optional text describing the purpose of the Data Product. Max 200 characters.
Resource name prefix Prefix used for all deployed resources (e.g., DP01). Up to 4 characters; must not start with a number or special character. Yes
Deployment environment Deployment environment identifier (e.g., qa, dev, prod). Maximum 4 characters. Yes
Resource group name Name for the Azure resource group to be created (e.g., Sidra.DP.MyProduct). Between 1 and 15 characters. Yes

  1. If you're using a custom VNet, select the Databricks private and public subnets you created earlier in Configure Data Product VNet.

  2. Once deployed, the new Data Product appears in the Sidra Web > Data Products section.

    Data Product Created

Validate in Azure Portal

Roughly 15 minutes after initiating the deployment, you can validate the full resource provisioning in the Azure Portal. The deployment includes:

  • Main resource group for the Data Product (e.g., Data.Domain.DP01)
  • Managed resource group for Azure Databricks (e.g., Data.Domain.DP01-dp01-qa-dbr)

Data Product RG