Sidra API module: Data Lake / Data Storage Units (DSU)¶
It contains endpoints to implement CRUD operations over the information related to the Data Storage Units (DSU) and the Data Lake. More information can be found in the Data Lake tables section.
It allows to retrieve the list of types of clusters supported by the platform. The list of cluster types is static and defined by the platform, it cannot be modified.
These are the available cluster types:
It allows to retrieve the list of DSU -or a particular DSU by its id- configured in the platform. Since the information of the DSU represents a set of Azure resources, it is not allowed to create, delete nor modify them using the API.
It contains CRUD endpoints to
LandingZone table. It is required to provide the
Id of the storage where the landing zone is located.
It also contains an endpoint to request a Shared Access Signature (SAS) token to upload an asset to the corresponding landing zone. The platform decides the landing zone based on the asset name which leads to the entity, provider, DSU and finally to the storage and landing zone to which it belongs.
It allows to configure and use the Azure Cognitive Search service.
It allows to retrieve the list of storages -or a particular storage by its id- used by the DSUs. Every storage is used with a purpose in the DSUs. That purpose is represented by the role associated to the storage. Since every storage represents an Azure Storage, it is not allowed to create, delete nor modify them using the API.
It allows to retrieve the list of storage roles defined in the platform. The list of storage roles is static and cannot be modified.
These are the available storage roles:
|0||Principal||The storage account is used as principal storage for data that is being used.|
|1||Staging||The storage account is used as a temporary storage (staging) during data movement.|
|2||Backup||The storage account is used for data backup.|