Sidra API module: Data Lake / Data Storage Units (DSU)

It contains endpoints to implement CRUD operations over the information related to the Data Storage Units (DSU) and the Data Lake. More information can be found in the Data Lake tables section.

ClusterTypes

It allows to retrieve the list of types of clusters supported by the platform. The list of cluster types is static and defined by the platform, it cannot be modified.

These are the available cluster types:

Id ClusterTypeName
1 HDInsightHadoop
2 Databricks

DataLakes

It allows to retrieve the list of DSU -or a particular DSU by its id- configured in the platform. Since the information of the DSU represents a set of Azure resources, it is not allowed to create, delete nor modify them using the API.

LandingZones

It contains CRUD endpoints to LandingZone table. It is required to provide the Id of the storage where the landing zone is located.

It also contains an endpoint to request a Shared Access Signature (SAS) token to upload an asset to the corresponding landing zone. The platform decides the landing zone based on the asset name which leads to the entity, provider, DSU and finally to the storage and landing zone to which it belongs.

SearchServices

It allows to configure and use the Azure Cognitive Search service.

Storages

It allows to retrieve the list of storages -or a particular storage by its id- used by the DSUs. Every storage is used with a purpose in the DSUs. That purpose is represented by the role associated to the storage. Since every storage represents an Azure Storage, it is not allowed to create, delete nor modify them using the API.

StorageRoles

It allows to retrieve the list of storage roles defined in the platform. The list of storage roles is static and cannot be modified.

These are the available storage roles:

Id StorageRoleName StorageRoleDescription
0 Principal The storage account is used as principal storage for data that is being used.
1 Staging The storage account is used as a temporary storage (staging) during data movement.
2 Backup The storage account is used for data backup.