Monitoring Microsoft Azure Data Factory

eG Enterprise provides a specialized Microsoft Azure Data Factory model for monitoring the health of data pipeline activities in Microsoft Azure environment.

Figure 1 : Layer model for Microsoft Azure Data Factory

The layer in Figure 1 is mapped to the tests that report metrics on the health of data pipeline activities in Microsoft Azure environment. Using the metrics reported by this test, administrators can find accurate answers for the following performance queries:

  • Were many pipelines and triggers created on the target Microsoft Azure Data Factory?

  • Were many pipelines detected with maximum number of failed/queued runs?

  • Were many pipelines detected with maximum number of failed activity/queued activity runs?

  • Were pipelines/triggers established successfully when Microsoft Azure Data Factory is integrated with SSIS, MVNet, Apache Airflow etc.?