Skip to content

Data Quality configuration

The infrastructure of Data Quality Service has some configuration tables. The following are the most important:

Settings table

Enables to configure these settings for the Sidra Web:

  • EntityMaxDataDocShowUI. Maximum number of validation reports displayed in the Sidra Web per Entity.
  • RowCountThresholdForSampling. If the dataset contains more rows that this value, the process will do a sampling to decide whether the entire dataset is marked as validation failure.
  • SamplingMaxErrorPercentage. If the percentage of error in the sampling is greater than this value, the entire dataset is marked as error.
  • SamplingPercentage. Percentage used to define the sampling extracted from the dataset.

Check Process table

Logging table for failed validation executions.

Result table

Table of results for Entities and Assets. It is related to the AssetStatus table.

AssetStatus table

This table shows the validation status for each Asset.

Suite table

This table shows the Suite-Entity relationship. A suite is a group of validations (or expectations).

Entity Delta Validation

This table shows the last validation check per Entity.