Skip to content

Sidra Data Platform (version 2025.08: Graceful Gijon)

Released on November 14, 2025

A new era of governance and efficiency...

This release marks a significant milestone in Sidra's evolution, bringing together major architectural improvements with cost-optimization initiatives. We're introducing a modernized Supervisor interface, migrating to industry-standard authorization with Keycloak, and unlocking advanced governance capabilities through Databricks Unity Catalog. Combined with our event-driven Data Product installation model and continued .NET 8 adoption, this release strengthens Sidra's position as a scalable, enterprise-ready platform.

Sidra 2025.08 Release Highlights

Supervisor UI Redesign

This release delivers a complete visual and functional overhaul of the Supervisor interface. The new design provides platform administrators with a more intuitive, responsive, and modern experience for managing Sidra installations.

The new Supervisor UI sets the foundation for future enhancements and aligns with modern design principles while maintaining the functionality administrators depend on.

Keycloak Integration for Authorization

We've migrated Sidra's authorization system from Balea to Keycloak, an industry-standard, open-source identity and access management solution. This change delivers several key benefits:

  • Reduced operational costs by eliminating Balea resources requirements
  • Enhanced security through battle-tested, enterprise-grade authorization
  • Better integration with existing identity providers and SSO systems
  • Simplified administration with Keycloak's comprehensive management interface

This transition maintains full compatibility with existing permission structures. Organizations can now leverage Keycloak's rich ecosystem of features, including advanced authentication flows and fine-grained access control policies.

Databricks Unity Catalog for Data Products

Sidra now supports Databricks Unity Catalog for Data Products, enabling centralized governance, discovery, and lineage tracking across your entire data estate. Unity Catalog provides:

  • Unified governance across all data within Data Products
  • Fine-grained access control at the table, column, and row level
  • Automated lineage tracking from source to consumption
  • Data discovery and cataloging across multiple workspaces
  • Audit logging for compliance and security requirements

This integration ensures that Data Products built on Sidra can leverage Databricks' most advanced governance capabilities, providing enterprise-grade data management and compliance features out of the box.

Event-Based Data Product Installation

We've extended our event-driven deployment model to Data Products, bringing the same benefits we previously introduced for platform services. This change significantly improves the deployment and update experience.

This release includes updated templates for Data Domain and AdvWorks Data Products, both now fully compatible with the event-based installation model. Existing Data Products will automatically benefit from these improvements during their next update cycle.

Entity Reload for Azure SQL and SQL Server

We've introduced the ability to reload specific entities within a Data Intake Process (DIP) for Azure SQL and SQL Server connectors. This feature enables operational scenarios that previously required complex metadata management:

  • Selective entity reload without affecting other entities in the same DIP
  • Reduced administrative overhead for common maintenance tasks

This capability is particularly valuable when dealing with schema evolution, data quality remediation, or selective data refresh scenarios.

Data Product API Upgraded to .NET 8

The Data Product API has been fully migrated to .NET 8 LTS, completing another milestone in our platform-wide modernization effort.

Issues Resolved in Sidra 2025.08

The following issues have been resolved in this release:

  • Fixed an issue in Sync job execution that could cause failures to occur silently without proper error reporting. #9340
  • Updated ADF Linked Services for Oracle to ensure compatibility with the latest Azure Data Factory runtime. #9683
  • Updated ADF Linked Services for MySQL to ensure compatibility with the latest Azure Data Factory runtime. #9682
  • Fixed an issue where the Oracle connector could not determine primary key columns when the metadata is created. #10156
  • Fixed an issue in the Oracle connector where the object restriction list did not work correctly when database names, schema names, or table names contained lowercase characters. #9658
  • Fixed an issue in the DB2 connector where the object restriction list did not work correctly when database names, schema names, or table names contained lowercase characters. #10073
  • Fixed an issue in the DB2 connector where ingestion failed silently when the schema name contained fewer than 8 characters. #10074

Coming Soon

We're already working on the next wave of improvements to the Sidra platform. Here's what's on the horizon:

  • DIP Reset and Full Reload
    We're introducing the ability to reload a DIP from scratch, resulting in a complete reset of all data loaded for that DIP. This feature will initially be available for Azure SQL and SQL Server connectors and will enable clean-slate scenarios for data remediation and re-architecting.

  • Enhanced Orchestrator Pipeline
    Improvements to the Orchestrator pipeline will enable better management of post-processing actions for all ADF Intake pipelines. Initially implemented for Azure SQL and SQL Server, this will provide greater flexibility for custom transformations and data quality checks immediately following ingestion.

  • Databricks Shared Tables for Data Synchronization
    We're developing support for data synchronization from DSU to Data Products using Databricks Shared Tables. This will enable more efficient data sharing patterns and reduce data duplication across the platform.

Stay tuned for these enhancements and more in upcoming releases.

We Want Your Feedback

Your ideas make Sidra better. For suggestions, issues, or questions, please reach out to us at info@sidra.dev.