4,917 questions with Azure Synapse Analytics tags

Sort by: Updated
3 answers

synapse analytics deployment error

I'm using my student account which gives $100 creidt. {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-07-25T21:30:54.1766667+00:00
Sahu, Hardeep - (hardeepsahu) 20 Reputation points
answered 2024-10-05T18:30:08.6433333+00:00
Gabor Stefan 0 Reputation points
0 answers

Sending Pipeline Failure Alerts via Logic App in ADF

How can a pipeline failure alert be sent via a Logic App when an activity fails in Azure Data Factory? I'm trying to extract the error message to send it via email using the following pipeline expressions: 1. @concat('Target: ',…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,149 questions
Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
3,133 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,175 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-10-05T08:59:59.42+00:00
Aditya Singh 160 Reputation points
1 answer

Serverless SQl pool has encountered an internal error

Hi all, I am getting this error while trying to run a simple query on an csv file connected to azure synapse studio via linked service; Serverless SQl pool has encountered an internal error Below is the error message from synapse studio. I did google…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-27T18:47:07.9966667+00:00
Tarunoday Sharma 0 Reputation points
commented 2024-10-05T08:42:44.4433333+00:00
Vinodh247 20,476 Reputation points
1 answer

Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.

Hi Support, I have the issue with the queries that I use everyday without any problem. However, today it shows this message. [This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-01T19:05:37.37+00:00
Phuoc Nguyen 0 Reputation points
commented 2024-10-05T08:42:18.03+00:00
Vinodh247 20,476 Reputation points
2 answers

Synapse notebooks are not using overriden spark resources configured with %% configure

We are trying to override default settings for synapse spark notebooks which used very fat configbfor executor memory/cores etc using magic commands like this, but when notebook is getting executed it still demands 12vcores and gives out of quota error…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-01T11:20:46.7866667+00:00
Raut, Saurabh J 0 Reputation points
commented 2024-10-05T01:34:58.6266667+00:00
Chandra Boorla 1,810 Reputation points Microsoft Vendor
1 answer

Azure Synapse Google Ads LinkedService

I was trying to create a linked service to a Google Ads account. I have obtained the Google Developer token through Google Ads and created a Google API project with Google Ads API. But I am getting the below error when testing the linked service. ERROR…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2023-11-27T04:23:01.8466667+00:00
MORA_160447G 5 Reputation points
commented 2024-10-04T18:48:42.0133333+00:00
BobGang-3117 6 Reputation points
0 answers

AZURE SYNAPSE ANALYTICS SQL POOL SERVERLESS is unavailable

Hello, Suddenly, from this morning, I cannot execute a sql request on my Azure Synapse Analytics. Indeed the SQL POOL SERVERLESS is unavailable (internal error). I have no detail and I have the same problem in my 2 environments (devlopement and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-23T09:19:21.1766667+00:00
Benjamin NOAILLY - TEAMWORK 0 Reputation points
commented 2024-10-04T16:41:53.85+00:00
Bhargava-MSFT 31,011 Reputation points Microsoft Employee
0 answers

Executing a synapse pipeline from a synapse notebook with parameter

Hello I'm currently working on executing a synapse pipeline directly from a synapse notebook and was wondering if there's a method to achieve this. Additionally, the synapse pipeline I'm working with requires specific parameters to function correctly.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-04T16:18:32.9666667+00:00
AinoKaisa 0 Reputation points
commented 2024-10-04T16:28:05.6066667+00:00
Tanish 0 Reputation points
1 answer One of the answers was accepted by the question author.

Can't get template-parameters-definition.json to expose Synapse parameters

Hello. I am new to this so please go easy. I want to be able to customise a couple of parameters when I deploy my Synapse workspace artifacts to another environment. I understand the way to do this is the template-parameters-definition.json in the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2023-08-17T15:50:20.5933333+00:00
Adam Peel 20 Reputation points
accepted 2024-10-04T15:29:28.9833333+00:00
Adam Peel 20 Reputation points
1 answer

Sending data frame as an attachment in email using synapse notebook (PySpark)?

Hello, Is it possible to send pyspark dataframe as an attachment in email using synapse notebook (PySpark)? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-03T17:25:48.6866667+00:00
Satheesh K 45 Reputation points
commented 2024-10-04T14:44:37.8633333+00:00
Satheesh K 45 Reputation points
1 answer

We have a requirement to export Oracle cloud fusion data to azure datalake at a monthly cadence. We are able to use rest connector, but getting error with Oracle service cloud connector

Synapse Oracle Service Cloud  (Preview) Connector form synapse is giving following error when using hostname in following format <>.<>.ocs.oraclecloud.com as specified in documentation and get following error . ERROR [HY000]…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-02T01:54:22.8166667+00:00
Dataarch_MM 0 Reputation points
commented 2024-10-04T13:47:22.4+00:00
Dataarch_MM 0 Reputation points
0 answers

Synapse Serverless SQL external table returns old data

An external table created in a Synapse Serverless SQL pool for an Azure Storage account Delta Table is not showing the data as it is in the Delta table.   When the external table was initially created the data in the table was incorrect. The decision was…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-27T11:01:11.09+00:00
Nelia Steenkamp 0 Reputation points
commented 2024-10-04T12:48:13.45+00:00
Smaran Thoomu 15,765 Reputation points Microsoft Vendor
1 answer

Synapse Workspace Common Data Model

Hi Team, We were referring to the database templates provided for common data model. We wanted to get the entities and attributes related to Supply chain and were unable to find the same. There Git repo seems to have a different set of entities. E.g.,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-26T12:04:41.8066667+00:00
Preethi Sankaranarayanan 0 Reputation points
commented 2024-10-04T10:55:03.3533333+00:00
PRADEEPCHEEKATLA-MSFT 89,386 Reputation points Microsoft Employee
1 answer

Sending data frame as an attachment in email using synapse notebook (PySpark)?

Hello, Can you please share if there is any documentation on How to send data frame as an attachment (csv or text) in email using synapse notebook? Is this possible or any limitations? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-03T17:23:26.03+00:00
Satheesh K 45 Reputation points
answered 2024-10-04T08:41:33.2+00:00
PRADEEPCHEEKATLA-MSFT 89,386 Reputation points Microsoft Employee
1 answer

Encrypt data on transit - Oracle OCI to Azure Synapse -

Hello - We are implementing a solution like this: Extract data from Oracle OCI database use Azure Synapse Analytics Store Data to Data lake gen 2 We have created linked service in Synapse to connect to oracle OCI db We have been asked how to make…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-20T07:19:30.7633333+00:00
Xhevahir Mehalla 25 Reputation points
commented 2024-10-04T03:46:36.26+00:00
phemanth 10,325 Reputation points Microsoft Vendor
1 answer

Why is ORDER BY not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?

Hi there, We want to use ORDER BY when creating external table in azure synapse, somehow the ORDER BY does not take effect, may I ask why ORDER BY is not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-02T21:04:57.2966667+00:00
Beifei Zhou 0 Reputation points
commented 2024-10-04T03:28:04.0966667+00:00
phemanth 10,325 Reputation points Microsoft Vendor
1 answer

ADF - converting list of lists into a proper JSON format

Hello, I'm pretty new to ADF and I can't wrap my head around one case. To keep it simple: I have a source (REST API response), which theoretically is JSON but it doesn't have a "proper" JSON format. It's supposed to be a simple table but it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-25T18:29:34.62+00:00
Patryk Sobczak 0 Reputation points
commented 2024-10-04T03:07:17.8066667+00:00
phemanth 10,325 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

Suggest a way to replicate data from on premise sql server 2019 to azure synaspe analytics directly

Im using an sql server in my on premise with version 2019, I need to transfer or replicate real time data to azure synapse database, so which azure service will be more effective and flexible for large data transfer

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,785 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-26T14:30:15.38+00:00
AGP 40 Reputation points
commented 2024-10-03T21:15:47.0133333+00:00
Erland Sommarskog 111.1K Reputation points MVP
1 answer

Passing dynamic parameter to %Run command in Synapse Notebook

So Im doing a test to see if we can dynamically send parameters from a parent notebook to a child notebook Child Notebook: from pyspark.sql import SparkSession from notebookutils import mssparkutils print(f"Storage Account Name:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-03T11:36:08.4+00:00
WZIAFP 157 Reputation points
answered 2024-10-03T20:29:46.1866667+00:00
Amira Bedhiafi 24,531 Reputation points
2 answers One of the answers was accepted by the question author.

How to add 100 plus source link in ADF pipeline to transfer data to single destintion.

I need to transfer data from multiple source sql servers( almost 100 plus) to a single destination using ADF, Is there is any way to add these much servers to ADF as source

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,785 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-29T13:21:02.1033333+00:00
AGP 40 Reputation points
accepted 2024-10-03T18:53:06.7366667+00:00
AGP 40 Reputation points