Skip to content

Learn about Sidra Service

Sidra Service (called before Sidra Core) is one of the main components of Sidra Data Platform.

In this website we will delve into the following concepts:

  • Metadata. This is the metadata definition used by the platform along with generic artifacts, a list of triggers, datasets and pipelines that are predefined in Sidra Data Platform.

  • Sidra's API. This a list of the different endpoints you can find in Sidra Service.

Common Services

The Sidra Service infrastructure will provide a set of common services to be used – and extended if needed – by the data lake clients.

common-services

These services are:

Operations Management
A centric view of the performance and reliability metrics is a must on a system like the one proposed here. A mechanism that allow to analyze the performance of each of the components and react to anomalies with auto-scaling or remediation actions will be implemented on the platform.

Security and Identity
A common UI and base security model will be provided to all applications siting on the platform. This model will be based on AD identities and will be extensible by each client.

API Management
Some of the applications will provide a set of APIs to interact with them. These should be handled by the API Management, which will allow to scale, secure, audit and monitor the different services provided by the data platform through its APIs.

Data Catalog
Some datasets are going to be potentially used across the complete platform. This data will be exposed from a common interface (API and SQL/Redis) to the Data Products, allowing to minimize the potential errors if every application needs to do the same tasks, as well as opening optimization opportunities.

Data Ingestion Anomaly Detection
A mechanism for the management of the enterprise data assets, including the data discovery and tagging, is something that a system which aims to promote the cohabitation of many data sets needs to provide.

Management UI
A contemporary, web-based management UI for developers and administrators aimed meet their requirements. It offers a visual user widget to ingest new data, an operational status tracking dashboard and Sidra log management.