Meagan Longoria has a multi-part series on using Biml to script Azure Data Factory tasks to migrate data from an on-prem SQL Server instance to Azure Data Lake Store. Here’s part 1:
My Azure Data Factory is made up of the following components:
-
Gateway – Allows ADF to retrieve data from an on premises data source
-
Linked Services – define the connection string and other connection properties for each source and destination
-
Datasets – Define a pointer to the data you want to process, sometimes defining the schema of the input and output data
-
Pipelines – combine the data sets and activities and define an execution schedule
Click through for the Biml.