TechPrufer
Get started
Microsoft
Microsoft logoMicrosoft · Feature trail

Azure Data Factory ETL and Data Integration

3 posts · Jun 2021

What this trail covers

This post introduces Azure Data Factory as a cloud-based ETL and data integration service for creating data-driven workflows. It covers orchestrating data movement and transforming data at scale, using built-in connectors, and visually constructing ETL processes with data flows or compute services like Azure HDInsight Hadoop, Azure Databricks, and Azure SQL Database. The post also touches on differences between ADF and Synapse, data lake ETL patterns, and building an ETL flow with sample data.

All Microsoft trails
  1. AzureFunBytes - @Azure Data Factory Security with @narainabhishekThis post details security best practices for Azure Data Factory, including authentication mechanisms, metadata encryption at rest, credential management strategies, securing data in transit and at rest, network security considerations, and integration with Azure Policy. It emphasizes following the Azure Security Benchmark for Data Factory and protecting login details to data endpoints.
  2. AzureFunBytes - Intro to Azure Data Factory with @KromerBigDataThis post introduces Azure Data Factory as a cloud-based ETL and data integration service. It covers creating data-driven workflows, orchestrating data movement, and transforming data at scale. It highlights the use of built-in connectors, visual ETL processes with data flows, and integration with compute services like Azure HDInsight Hadoop, Azure Databricks, and Azure SQL Database. The post also discusses differences between ADF and Synapse, data lake ETL patterns, and provides a demo of building an ETL flow using sample data.