4,627 questions with Azure Synapse Analytics tags

Sort by: Updated
Updated Created Answers
2 answers One of the answers was accepted by the question author.

find character position of nth occurrence in a string in ADF

I have a field of string data and need to find nth occurrence of character position using ADF. example: instr('microsoft is good') first occurrence: 5 second occurrence: 7 third occurrence: 15 fourth occurrence: 16

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,023 questions
asked 2024-07-05T21:58:29.1233333+00:00
Peruka, Sikander reddy 65 Reputation points
answered 2024-07-07T08:23:05.94+00:00
Nandan Hegde 30,871 Reputation points MVP
1 answer

Azure synapse and reserved pricing discount

From looking at the link here https://azureaggregator.wordpress.com/2021/02/09/data-flows-in-adf-and-synapse-now-support-reserved-instance-pricing/ and …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-02T14:58:46.54+00:00
MrFlinstone 501 Reputation points
commented 2024-07-06T16:00:24.4533333+00:00
ShaikMaheer-MSFT 38,321 Reputation points Microsoft Employee
1 answer

Missing ODBC drivers on spark 3.3 & 3.4 version

Hi Team - We are upgrading our Spark version from 3.2 to 3.4 and using the pyodbc module for SQL operations. However, we are encountering the following error when attempting to connect to the Azure SQL Database. Could someone please assist…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-05T20:55:19.18+00:00
Abhiram Duvvuru 211 Reputation points Microsoft Employee
answered 2024-07-06T13:36:52.07+00:00
Amira Bedhiafi 18,501 Reputation points
0 answers

Synapse custom event trigger publish is not happening on event grid with master branch

Hi all, I have requirement to trigger synapse pipeline when I publish event on event grid. Without git integration when I configure the Trigger and click on publish button, subscription is appearing on Event grid and trigger is working fine. With git…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
343 questions
asked 2024-07-04T07:51:20.4733333+00:00
Madhu Challapalli 20 Reputation points
commented 2024-07-06T09:46:23.5866667+00:00
phemanth 8,165 Reputation points Microsoft Vendor
1 answer

App could not could not connect to Azure Synapse when created via ARM template - SSL connection could not be established

Hello. I need your help with smth that we find a difficult to resolve. Here's the current setup: I have created an Azure Synapse workspace using ARM templates. All is working well apart from when an App which has been build on Angular could not connect…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
7,273 questions
asked 2024-06-21T07:56:17.4333333+00:00
Xhevahir Mehalla 140 Reputation points
commented 2024-07-06T08:28:28.1566667+00:00
Xhevahir Mehalla 140 Reputation points
2 answers One of the answers was accepted by the question author.

I cannot access synapse workspace in Azure. error code

Failed to load Failed to load role assignments due to forbidden issue, error code 403. Refresh or troubleshoot the issue. Please can someone help. I am the owner of the subscription.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-05-09T15:19:23.46+00:00
Xhevahir Mehalla 140 Reputation points
commented 2024-07-06T08:22:11.9033333+00:00
Xhevahir Mehalla 140 Reputation points
1 answer

multiple lookup in copy activity

Hi, how to handle multiple lookup column as input in copy activity

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,023 questions
asked 2024-07-06T02:27:07.44+00:00
Vineet S 285 Reputation points
answered 2024-07-06T06:03:36.7+00:00
Nandan Hegde 30,871 Reputation points MVP
1 answer One of the answers was accepted by the question author.

multiple join in adf pipeline

Hi, and how to to handle select statement with multiple join in adf pipeline

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,023 questions
asked 2024-07-06T02:28:47.5633333+00:00
Vineet S 285 Reputation points
accepted 2024-07-06T06:01:53.1166667+00:00
Vineet S 285 Reputation points
0 answers

synapse notebook

Hi , how we can add link services created in synapse in notebook available azure synapse link servicename :test2 select * from test1.table1

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-03T09:23:09.2166667+00:00
Vineet S 285 Reputation points
commented 2024-07-06T05:02:04.6733333+00:00
phemanth 8,165 Reputation points Microsoft Vendor
0 answers

installing wheel packages on spark pool - Synapse DEP enabled workspaces

Hi, I have a Synapse workspace with DEP enabled, and since PyPI libraries cannot be installed directly in the Spark pool, I want to install azure-mgmt-kusto and azure-kusto-data on the pool. I tried the following methods but encountered the error…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-05T23:13:00.32+00:00
Abhiram Duvvuru 211 Reputation points Microsoft Employee
edited the question 2024-07-05T23:20:35.0266667+00:00
Abhiram Duvvuru 211 Reputation points Microsoft Employee
1 answer

Is there a way to collect Synapse's Spark UI logs through an API?

Is there a way to automate the process to send get request to receive bearer token for this API:…

Azure API Management
Azure API Management
An Azure service that provides a hybrid, multi-cloud management platform for APIs.
1,911 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-05T20:25:12.74+00:00
S 0 Reputation points Microsoft Intern
answered 2024-07-05T21:46:24.11+00:00
Sina Salam 6,581 Reputation points
1 answer

merge statement in 2 data frame

Hi , how to use merge statement in 2 dataframe df1=spark.sql("" sellect cole1,col2 from table1""") df2=spark.sql("" sellect cole1,col2 from table2""") expected results merge into table2 using tabl1 on…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,047 questions
asked 2024-07-04T19:49:06.46+00:00
Vineet S 285 Reputation points
commented 2024-07-05T19:43:53.35+00:00
Vineet S 285 Reputation points
2 answers

Azure Synaps serverless scan file that should be filtered

Hey, We have a large amount of files stored in Storage Account in Parquet format with the following hierarchy. /m_id=%M_ID%/quarter=%QUARTER%/month=%MONTH%/partition_version=last/part-0.parquet'. examples for quarter values: 2024Q1, 2024Q2, 2024Q3…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-01T08:48:06.6533333+00:00
Shlomi Lanton 56 Reputation points
edited an answer 2024-07-05T17:09:50.8733333+00:00
BhargavaGunnam-MSFT 28,616 Reputation points Microsoft Employee
1 answer

How to Handle Errors and Row Counts in Synapse Stored Procedures

I'm migrating a stored procedure from a Data Warehouse to Azure Synapse Dedicated SQL pool. The procedure uses @@error and @@rowcount variables, which are not supported in Synapse. Are there alternative ways to achieve the same functionality without…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-02T13:05:32.38+00:00
vikranth-0706 180 Reputation points
edited a comment 2024-07-05T16:03:12.93+00:00
BhargavaGunnam-MSFT 28,616 Reputation points Microsoft Employee
2 answers

Extracting Purchaser Data from Azure Synapse for Marketing Automation

I'm looking to connect Azure Synapse Analytics with a marketing automation platform. My goal is to identify recent purchasers from my existing Azure Synapse data and send them targeted emails using the marketing platform. While I can handle sending…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-04T09:11:47.34+00:00
vikranth-0706 180 Reputation points
commented 2024-07-05T11:39:06.7766667+00:00
Smaran Thoomu 12,105 Reputation points Microsoft Vendor
1 answer

How to create sha256 signature for Oracle Cloud integration Rest API ?

Hi Experts, Infra: Azure Synapse -we are using pipelines / API method to get data and create a Data Warehouse. Source: We have an Oracle Cloud Infrastructure (OCI ) as source , that will output the report to Oracle Cloud Storage. OCI has a REST API…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,023 questions
asked 2024-07-04T03:27:38.67+00:00
Caniut Alex 0 Reputation points
commented 2024-07-05T11:29:07.3166667+00:00
Smaran Thoomu 12,105 Reputation points Microsoft Vendor
1 answer

Error while creating linked service from Synapse to Dyanamics 365

I am trying to create Linked Service from Microsoft Synapse to Dynamics 365. While testing connect I am getting error ClientIpAddressNotAuthorized. We have licensed Microsft Synapse and trial version of Dynamics 365.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-03T06:15:50.9666667+00:00
Rakesh Gupta 0 Reputation points
commented 2024-07-05T08:55:55.94+00:00
Harishga 5,590 Reputation points Microsoft Vendor
0 answers

What is the mechanism to implement SSL when connecting from a third party application or IPaas platforms to Azure Synapse database either in serverless sql pool or ded

How can we implement SSL between any IPass platform and Azure Synapse. Is it different when connecting to a serverless sql pool db vs dedicated sql pool db.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-04T05:05:33.12+00:00
Amit Chakraborty 0 Reputation points
commented 2024-07-05T08:50:08.27+00:00
Harishga 5,590 Reputation points Microsoft Vendor
0 answers

Issues Connecting to Infor Data Lake Using Spark JDBC in Azure Synapse Spark Notebook

Hi Team, I'm encountering difficulties while attempting to connect to Infor Data Lake using Spark JDBC within Azure Synapse. Despite configuring the necessary JDBC driver and ionapi file path, I consistently encounter the following…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
asked 2024-07-04T09:19:18.87+00:00
Sriram M 20 Reputation points
commented 2024-07-05T08:45:53.77+00:00
Sriram M 20 Reputation points
5 answers

CosmosDB Analytical store delete changes in sql sink

Hi I am trying to capture delete changes from Azure cosmosdb analytical store using change data capture in Azure datafactory, Source is Cosmosdb, sink is Azure sql database. In between I am flattening my file using dataflow. My insert, update is…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,627 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,520 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,023 questions
asked 2024-04-30T13:52:46.2133333+00:00
Kuldeep Bhati 0 Reputation points
commented 2024-07-05T05:56:51.36+00:00
Harishga 5,590 Reputation points Microsoft Vendor