Supported data sync mechanism: Incremental Load with built-in System-period temporal tables¶
The incremental load in DB2 and DB2 iSeries databases is supported through system-period temporal tables method.
For more information on how to activate System-period temporal tables in a DB2 and DB2 iSeries databases, please check the IBM Documentation:
Sidra supports delete operations for system-period temporal tables. The delete support has been incorporated to Transfer Query/DSU ingestion scripts. When a change happens, in DB2 and DB2 iSeries databases:
- System-period temporal tables store the information of the changes.
- The column
SYS_STARTwill be updated with the date of the last operation performed.
OP_CODEcolumn act as a marker for the change with the following values:
- U: Update.
- I: Insert.
- D: Delete.
Sidra adds a new metadata field
SidraIsDeletedto the table in the Data Lake (different scenarios can be checked here).
- When the column
OP_CODEon the source has the value "D", column
SidraIsDeletedon the Data Lake is set to