12,210 questions with Azure Data Factory tags

Sort by: Updated
1 answer

Tested changing Basic Authentication for Snowflake to Key Pair in a Dev ADF branch but switched back to Basic afterwards and now we fail running pipelines with trigger this pipeline now (debug run works though)

We needed to test changing our Snowflake v2 linked service from Basic authentication to Key Pair authentication so we updated the Snowflake linked service to keypair, uploaded the .p8 file, and changed a global parameter (for username change) in a…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-08-07T14:29:45.78+00:00
JB 201 Reputation points
edited a comment 2026-08-07T18:35:09.0766667+00:00
JB 201 Reputation points
2 answers

From AME unable to create ADF Linked Service connection for CORP KUSTO using CORP SPN

Hello Team, I am trying to create a Linked Service in AME ADF for CORP Kusto cluster. For that I have created SPN in AME and marked it as multi-tenant. This SPN is also created in CORP. However, AME ADF is throwing error that SPN USER does not have…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-20T19:32:22.4233333+00:00
Hemant 61 Reputation points Microsoft External Staff
commented 2026-08-07T17:54:47.0333333+00:00
Smaran Thoomu 170 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

When should OneLake Shortcuts be preferred over Copy Activity in Microsoft Fabric?

Hi everyone, I'm currently learning Microsoft Fabric and recently completed the Microsoft Learn module about organizing a Fabric Lakehouse using the Medallion Architecture. I understand that both OneLake Shortcuts and Copy Activity can be used to access…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-28T07:43:53.91+00:00
Vincentius Indrayanto 20 Reputation points
accepted 2026-08-07T15:25:31.0633333+00:00
Vincentius Indrayanto 20 Reputation points
2 answers

Azure Data Factory Parameter Limitation Issue

Hi, I am having problem when deploying data factory for my batch data. The error is regarding the parameter limitation of 256 parameters, but the number of parameters were 259. I believe this error root cause is the dependency to ARM which having hard…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-08-07T08:22:02.15+00:00
Roime Bin Puniran 0 Reputation points
answered 2026-08-07T12:56:58.3233333+00:00
Peram Venkateswara Reddy 5 Reputation points Microsoft External Staff Moderator
1 answer

CORP ADF Linked Service On-prem SQL Connection started failing from 7/19/2026

Hello Team, Existing CORP ADF Linked Service on-prem SQL connections are failing. Due this our team is unable to function. Please help at the earliest.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-20T22:57:21.2133333+00:00
Hemant 61 Reputation points Microsoft External Staff
edited a comment 2026-08-07T09:43:53.9566667+00:00
Ana Mihaila (BLUEHAWK LLC) 0 Reputation points Microsoft External Staff Moderator
1 answer

Trying to filter csv file based on content

I have an existing ADF pipeline that is creating an error due to some bad (or not acceptable data) displayed on the csv file. Basically, instead of having proper header on the first row with certain amount columns (with data), csv file displays data like…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-22T21:45:14.68+00:00
Justin Doh 1,000 Reputation points
edited a comment 2026-08-07T00:41:24.82+00:00
Justin Doh 1,000 Reputation points
3 answers

How to fix this data factory creation issue in azure for student account

While creating Azure data factory under the resource getting error

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-28T05:12:59.47+00:00
Vidhyasagar V 0 Reputation points
commented 2026-08-06T10:58:51.9666667+00:00
Ganesh Chelluri 110 Reputation points Microsoft External Staff Moderator
2 answers

Azure Data Factory: Inquiry on New Undocumented Property 'trustModeClaimForMi'

It looks like PG added a new undocumented property on data factory resource properties: "trustModeClaimForMi": { "value": "Enabled", "editable": true } Any ideas about this and any ETA when…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2025-08-08T09:06:38.5766667+00:00
Janne Kujanpää 266 Reputation points
commented 2026-08-06T08:11:23.31+00:00
Jaap van der Herberg 0 Reputation points
1 answer

Best practice for calling Azure OpenAI from an ADF pipeline for row-level enrichment without hitting 429 throttling?

I'm building a pipeline in Azure Data Factory that lands semi-structured support-ticket data into Snowflake, and I want to enrich each record with a short summary and a category label generated by Azure OpenAI (gpt-4o-mini deployment) before the load…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-31T21:56:02.2833333+00:00
Sahib Gasimov 0 Reputation points
commented 2026-08-06T07:58:13.95+00:00
Peram Venkateswara Reddy 5 Reputation points Microsoft External Staff Moderator
1 answer

How to un-install Microsoft Data Integration ABAP Add-On from SAP

Hi, From what Microsoft has published, there is an installation/setup guide for the Microsoft Data Integration ABAP Add-On for Fabric however I can not find any documentation which details Detailed upgrade procedures Detailed uninstall procedures …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-31T03:00:19.12+00:00
Pranic, Anita 0 Reputation points
commented 2026-08-06T07:47:01.9733333+00:00
Peram Venkateswara Reddy 5 Reputation points Microsoft External Staff Moderator
2 answers

ADF Copy Activity Performance Issue: Why Are .XLSM Files Slower Than .XLSX or CSV Files?

Hi Community, We are experiencing a performance issue in Azure Data Factory Copy Activity when reading Excel files. We noticed that copying data from .xlsm (macro-enabled Excel) files takes significantly longer compared to .xlsx or .csv files, even when…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-27T10:17:13.7266667+00:00
Yernaidu Siraparapu 125 Reputation points
commented 2026-08-06T02:41:45.9466667+00:00
Ganesh Chelluri 110 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

Fabric Pipeline copy activities (source: on-premises MariaDB via on-premises data gateway) are failing.

Test Connection on the Copy Activity returns: {"errorCode":41,"parameters":[],"activityId":"asdsdx-asdv32144-xasf2-43-asd","message":"An internal error has occurred. Please retry the operation at a…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-29T08:06:47.0366667+00:00
Oleksii Roiko 20 Reputation points
accepted 2026-08-05T11:54:30.1866667+00:00
Oleksii Roiko 20 Reputation points
1 answer

ADF failed to connect the SAP CDC table (ECC) by SAP CDC Connector

Hello Need support. When I use ADF to load data from SAP CDC for example this table - it's error in "Preview ODP"as the screen shows. We confirm the table source "ZDDL_VBEP_BODS" is existing。 contact by email/teams …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-30T08:02:27.4066667+00:00
锐珂医疗-Hennie Ye 0 Reputation points
commented 2026-08-05T08:33:25.8066667+00:00
Peram Venkateswara Reddy 5 Reputation points Microsoft External Staff Moderator
1 answer

Reading organizational app + audience data via the Fabric REST API with a service principal. Is app-only supported?

We want to programmatically read organizational apps (org apps) and their audiences in Power BI / Fabric, for governance and auditing purposes. We're looking at the Fabric REST API, specifically Get Org App:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-08-03T14:02:33.6833333+00:00
Ilyass el Allali 0 Reputation points
commented 2026-08-04T17:04:48.4566667+00:00
Ganesh Chelluri 110 Reputation points Microsoft External Staff Moderator
4 answers

Azure Data Factory HubSpot Connector v2 fails when HubSpot returns empty string ("") for DateTime property notes_next_activity_date

Hello Microsoft Team, I believe I have found a reproducible issue with the Azure Data Factory native HubSpot Connector (v2). I have spent several days investigating this issue and created a minimal reproducible example. Before opening a paid support…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-31T09:24:40.2433333+00:00
Neel Prajapati 0 Reputation points
commented 2026-08-03T12:17:48.6666667+00:00
Senthil kumar 1,730 Reputation points
1 answer

Data Factory Copy Activity is failing for Hubspot data source

A Data Factory Copy Activity, sourcing data from a HubSpot connector and sinking to a CSV file in a data lake, is consistently failing with a data type conversion error on the source side. The pipeline is attempting to copy data without an explicitly…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2025-10-24T18:19:21.0833333+00:00
Peter Blatchley 5 Reputation points
commented 2026-08-03T05:17:13.2166667+00:00
Neel Prajapati 0 Reputation points
3 answers

I am not able to create Azuredata factory.

This error is showing while i am trying to create ADF "Resource 'adfdemoproject001' was disallowed by Azure: This policy maintains a set of best available regions where your subscription can deploy resources. The objective of this policy is to…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-08-02T05:02:24.0066667+00:00
Nihar Ranjan 0 Reputation points
answered 2026-08-02T06:40:12.2866667+00:00
Senthil kumar 1,730 Reputation points
1 answer

"message":"Cannot read properties of undefined (reading 'named')"} while running on gitlab

I have simple adf pipeline which I want to validate and generate arm template via git lab ci cd yml with Node 20 and "@microsoft/azure-data-factory-utilities": "^1.0.0" but while I am doing validation it failing with error as below…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-22T21:08:45.3733333+00:00
Ar Gh 0 Reputation points
commented 2026-07-30T23:43:12.52+00:00
Ganesh Chelluri 110 Reputation points Microsoft External Staff Moderator
4 answers

How to Remove Password Protection from an XLSM Sheet in SharePoint and Copy the File to ADLS?

Hi everyone, I have an .xlsm file stored in SharePoint, and one of the worksheets is password-protected. As part of my data pipeline, I need to: Remove the worksheet password protection. Keep the workbook in .xlsm format. Copy the updated file to Azure…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-07-22T10:42:42.6266667+00:00
Yernaidu Siraparapu 125 Reputation points
commented 2026-07-30T23:41:24.74+00:00
Ganesh Chelluri 110 Reputation points Microsoft External Staff Moderator
0 answers

Join: Microsoft Azure Q&A Champions Program

The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,210 questions
asked 2026-05-25T23:37:24.3633333+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
edited the question 2026-07-28T21:45:22.8566667+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator