Skip to content

Sidra API

Several APIs are exposed by Sidra to enable the integration of third-party tools in areas such as Data Catalog or Data Querying.

Swagger

Sidra API is in continuous improvement, so the endpoints could change among time. For more information about the specifics of the Sidra API endpoints, a Swagger documentation is deployed with every Sidra API and it can be accessed from the base URL where Sidra API is deployed.

The base URL depends on the specifics of the installation, the environment and the naming conventions. Sidra API is deployed in an Azure App service instance and the default naming is:

https://core-<<name of the installation>>-<<environment>>-wst-api.azurewebsites.net

For example:

https://core-mycompany-dev-wst-api.azurewebsites.net

It is possible that there are two Azure App Service created in the same resource group; this is because one is for Sidra API (the one that ends with -api) and the other is for Web frontend application (the one that ends with -frontend). This document focuses on the Sidra API, not the Web frontend.

Identifiers

Many of the endpoints uses identifiers of the items that they are working on. For example, to retrieve a certain element by its identifier. There are two types of identifiers in Sidra:

  • Identifier: it is an identifier for an element to distinguish from the rest of elements of the same type. It is an integer and its value is usually autogenerated. The field used to stored it is called Id in the element to be identified and Id<<Element name>> when it is a field from other element referencing it. For example, the Provider has a field Id and the Entity has a field named IdProvider to refer the Id from the Provider.
  • Item Identifier: it is a global identifier of an element across all the Sidra installations. It is a GUID and its value is usually provided during the creation of the element. The field is called ItemId.

Modules

The API surface is organized in modules that provides endpoints that are related between them:

Module Endpoints Content
Metadata DataSource, Plugin, Provider, Entity, Asset, Attributes, Tags It contains endpoints to implement CRUD operations -Create, Read, Update, Delete- over the meta-information related to Assets. More information can be found in the metadata section section.
Data Factory ActivityTemplates, DataFactories, DataSetTemplates, Pipelines, PipelineTemplates, Triggers, TriggerTemplates, PII It contains endpoints to implement CRUD operations over the information related to Data Factory. More information can be found in the Data Factory tables section.
Data Storage Unit ClusterTypes, DataStorageUnits, DataIntake, LandingZones, SearchServices, Storages, StorageRoles It contains endpoints to implement CRUD operations over the information related to the Data Storage Units (DSU) and the Data Lake. More information can be found in the Data Lake tables section.
Management App, Configuration, DataFactoryMetricLogs, Image, Logs, Installation, Notifications, Permissions, Type Translation, ReleaseNotes, Service This module contains endpoints for retrieving information about the Sidra installation: notifications, logs, configuration values, etc.
Identity Identity, IdentityServerUsers Sidra platform uses IdentityServer4 for user authentication.
Ingestion Inference, Ingestion It contains endpoints to provide Asset ingestion into the platform.
Data Querying Query A tutorial is shown in order to showcase how to use the Query API in Sidra.