How to to do smoke testing for Azure Data Factory based pipeline

Kenny_I

I have On-premise SQL Server->ADF->Storage->ADF->Azure SQL pipeline. I'm using Azure DevOps. ADF pipelines are executed every night and ADF monitor displays errors if such exists.

I wonder if there is ADF or other frameworks for doing build specific smoke testing before functional testing etc.

UtkarshPal-MT

Unfortunately, there is no in-built feature in ADF to perform smoke testing. You need to manage it programmatically.

Alternatively, instead of triggering the pipeline directly it's better to run the debug and check for any error. There is also Mapping data flow debug mode for Data Flow pipelines which actually runs each step in the data flow before executing/triggering the final pipeline.

enter image description here

You can visit Integrating Smoke Tests into your Continuous Delivery Pipeline and check if this can be applied to your case.

Collected from the Internet

Please contact [email protected] to delete if infringement.

edited at
0

Comments

0 comments
Login to comment

Related

How to fail Azure Data Factory pipeline based on IF Task

Azure Data Factory Pipeline run based on parameters

How to pass parameter to pipeline in azure data factory?

How do I move a pipeline from an Azure Data Factory V2 to another (same Resource Group)?

How do I authenticate with Azure in order to run a data factory pipeline test with python behave?

How to trigger Azure Data Factory pipeline using PowerShell (Azure Automation)?

How to wait for Azure Data Factory pipeline to complete in Azure DevOps?

Azure Function versus Data Factory pipeline, which do you recommend?

Azure Data Factory Pipeline Cost

How to use dynamic connectors for source data in azure data factory pipeline

How to transform a JSON data directly in a Azure Data Factory pipeline

How to pass variable to Execute Pipeline in Azure Data Factory?

How to increase performance of Azure Data Factory Pipeline with Integration Runtime

How to execute Power Automate at the successful completion of Azure data factory pipeline?

How do i Re-run pipeline with only failed activities/Dataset in Azure Data Factory V2?

How to pass variable from main pipeline to child pipeline in Azure Data Factory?

Delete Multiple Azure Data Factory Pipeline

Query by date in Azure Data Factory Pipeline

Azure Data Factory Pipeline Consumption Details

Python Azure Data Factory Update Pipeline

Export and Import Single Azure Data Factory Pipeline

Executing custom activity on Azure Data Factory Pipeline

Azure Data Factory Pipeline deployment with PowerShell

azure data factory pipeline and activities Monitor

Azure data factory - Concurrence problem in the child pipeline

How to drive a Azure Data Factory based off of SQL Server values

how to pass "Data Flow/Data Set" parameters to azure data factory pipeline from Python SDK

Use pipeline parameters in azure data factory copy pipeline

How to delete ingested data when azure data factory pipeline run is cancelled?