Bitzu

AZ-305 ยท Data integration and analysis

Azure Data Factory pipelines

Azure Data Factory pipelines, activities, linked services, integration runtimes (Azure, self-hosted, Azure-SSIS), mapping data flows, ETL vs ELT.

Key points

  • Pipeline: logical group of activities (Copy, Lookup, ForEach).
  • Linked service: connection details; integration runtime (IR): compute linking them.
  • Azure IR: managed, serverless; mapping data flows, cloud copies.
  • Self-hosted IR: Windows in your private network, outbound-only HTTP; on-premises sources.
  • Azure-SSIS IR: managed VMs for existing SSIS packages.
  • Mapping data flows: code-free, ADF-managed Spark.

Source: https://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime

Practice questions

Single choice

Which integration runtime type natively executes SQL Server Integration Services (SSIS) packages in Azure Data Factory?

  1. Azure integration runtime
  2. Self-hosted integration runtime
  3. Azure-SSIS integration runtime
  4. Managed virtual network runtime
Show answer

Answer: C. Azure-SSIS integration runtime

The Azure-SSIS IR is a managed cluster of Azure VMs dedicated to running SSIS packages. The Azure IR runs data flows, copies and activity dispatch, and the self-hosted IR handles private-network copies, but neither executes SSIS packages.

Select all that apply

Which statements about mapping data flows in Azure Data Factory are correct?

  1. They are built visually, without writing transformation code
  2. They can run on a self-hosted IR inside your datacenter
  3. They execute on Spark clusters managed by the service
  4. They run as a Data Flow activity inside a pipeline
  5. They require you to provision an HDInsight cluster first
Show answer

Answer: A. They are built visually, without writing transformation code, C. They execute on Spark clusters managed by the service, D. They run as a Data Flow activity inside a pipeline

Mapping data flows are designed visually without code, run on scaled-out Spark clusters that ADF manages, and are operationalized through the Data Flow activity inside a pipeline. They run only on an Azure IR, not a self-hosted IR, and you do not provision your own HDInsight cluster for them.

True or false

To keep transformation work inside the corporate network, you can run a mapping data flow on a self-hosted integration runtime.

Show answer

Answer: False

False. Data Flow activities execute only on an Azure IR, whose data flow properties define the managed Spark compute. A self-hosted IR supports data movement and activity dispatch, not data flows.

Practice 8 questions on this topic in Bitzu

Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.

Download on the App StoreGet it on Google Play

More AZ-305 topics in this module