Skip to content

Data Factory Metric Logs

It allows to retrieve the logs of Data Factory pipelines executions applying different sets of filters. The logs are retrieved from the Util.DataFactoryPipelineRun table in the Log database in Core.

DataFactoryPipelineRun

Log database stores a copy of the logs (traces) of the platform, by applying a set of filters.

This table stores information about pipeline executions in Azure Data Factory.

Name Description
LogDate Timestamp of log message.
RunId Run Id of Data Factory pipeline.
RunGroupId Run Group Id in Data Factory. Identifier that correlates all the recovery runs of a pipeline run.
IsLatest Flag indicating whether the pipeline run is the latest in its group.
PipelineName Name of the Pipeline.
LastUpdated The last updated timestamp for the pipeline run event.
RunStart Timestamp of start of pipeline run.
RunEnd Timestamp of end of pipeline run.
DurationInMs Total duration in ms of pipeline run.
Status Pipeline run status.
Message The message from a pipeline run.

You can see more detail information in Azure Data Factory help pages.

DataFactoryActivityRun

This table stores information about activity executions in Azure Data Factory.

Name Description
LogDate Timestamp of log message.
PipelineName Name of the pipeline to which this activity belongs.
PipelineRunId Run Id of the pipeline to which this activity belongs.
ActivityName Name of the activity.
ActivityRunId Id of the activity run.
ActivityStatus Status of the activity run.
ActivityRunStart The start time of activity run.
ActivityRunEnd The end time of activity run.
ActivityDuration The duration of activity run in ms.
PipelineDuration Total duration in ms of pipeline run.
ActivityError Error message of activity run.

You can see more detail information in Azure Data Factory help pages.


Sidra Ideas Portal


Last update: 2022-07-14
Back to top