4,268 questions with Azure Synapse Analytics tags

Sort by: Updated
3 answers

synapse analytics deployment error

I'm using my student account which gives $100 creidt. {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-07-25T21:30:54.1766667+00:00
Sahu, Hardeep - (hardeepsahu) 20 Reputation points
answered 2024-10-05T18:30:08.6433333+00:00
Gabor Stefan 0 Reputation points
1 answer

Serverless SQl pool has encountered an internal error

Hi all, I am getting this error while trying to run a simple query on an csv file connected to azure synapse studio via linked service; Serverless SQl pool has encountered an internal error Below is the error message from synapse studio. I did google…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-27T18:47:07.9966667+00:00
Tarunoday Sharma 0 Reputation points
commented 2024-10-05T08:42:44.4433333+00:00
Vinodh247 20,476 Reputation points
1 answer

Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.

Hi Support, I have the issue with the queries that I use everyday without any problem. However, today it shows this message. [This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-01T19:05:37.37+00:00
Phuoc Nguyen 0 Reputation points
commented 2024-10-05T08:42:18.03+00:00
Vinodh247 20,476 Reputation points
2 answers

Synapse notebooks are not using overriden spark resources configured with %% configure

We are trying to override default settings for synapse spark notebooks which used very fat configbfor executor memory/cores etc using magic commands like this, but when notebook is getting executed it still demands 12vcores and gives out of quota error…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-01T11:20:46.7866667+00:00
Raut, Saurabh J 0 Reputation points
commented 2024-10-05T01:34:58.6266667+00:00
Chandra Boorla 1,810 Reputation points Microsoft Vendor
1 answer

Azure Synapse Google Ads LinkedService

I was trying to create a linked service to a Google Ads account. I have obtained the Google Developer token through Google Ads and created a Google API project with Google Ads API. But I am getting the below error when testing the linked service. ERROR…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2023-11-27T04:23:01.8466667+00:00
MORA_160447G 5 Reputation points
commented 2024-10-04T18:48:42.0133333+00:00
BobGang-3117 6 Reputation points
1 answer One of the answers was accepted by the question author.

Can't get template-parameters-definition.json to expose Synapse parameters

Hello. I am new to this so please go easy. I want to be able to customise a couple of parameters when I deploy my Synapse workspace artifacts to another environment. I understand the way to do this is the template-parameters-definition.json in the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2023-08-17T15:50:20.5933333+00:00
Adam Peel 20 Reputation points
accepted 2024-10-04T15:29:28.9833333+00:00
Adam Peel 20 Reputation points
1 answer

Sending data frame as an attachment in email using synapse notebook (PySpark)?

Hello, Is it possible to send pyspark dataframe as an attachment in email using synapse notebook (PySpark)? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-03T17:25:48.6866667+00:00
Satheesh K 45 Reputation points
commented 2024-10-04T14:44:37.8633333+00:00
Satheesh K 45 Reputation points
1 answer

We have a requirement to export Oracle cloud fusion data to azure datalake at a monthly cadence. We are able to use rest connector, but getting error with Oracle service cloud connector

Synapse Oracle Service Cloud  (Preview) Connector form synapse is giving following error when using hostname in following format <>.<>.ocs.oraclecloud.com as specified in documentation and get following error . ERROR [HY000]…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-02T01:54:22.8166667+00:00
Dataarch_MM 0 Reputation points
commented 2024-10-04T13:47:22.4+00:00
Dataarch_MM 0 Reputation points
1 answer

Synapse Workspace Common Data Model

Hi Team, We were referring to the database templates provided for common data model. We wanted to get the entities and attributes related to Supply chain and were unable to find the same. There Git repo seems to have a different set of entities. E.g.,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-26T12:04:41.8066667+00:00
Preethi Sankaranarayanan 0 Reputation points
commented 2024-10-04T10:55:03.3533333+00:00
PRADEEPCHEEKATLA-MSFT 89,386 Reputation points Microsoft Employee
1 answer

Sending data frame as an attachment in email using synapse notebook (PySpark)?

Hello, Can you please share if there is any documentation on How to send data frame as an attachment (csv or text) in email using synapse notebook? Is this possible or any limitations? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-03T17:23:26.03+00:00
Satheesh K 45 Reputation points
answered 2024-10-04T08:41:33.2+00:00
PRADEEPCHEEKATLA-MSFT 89,386 Reputation points Microsoft Employee
1 answer

Encrypt data on transit - Oracle OCI to Azure Synapse -

Hello - We are implementing a solution like this: Extract data from Oracle OCI database use Azure Synapse Analytics Store Data to Data lake gen 2 We have created linked service in Synapse to connect to oracle OCI db We have been asked how to make…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-20T07:19:30.7633333+00:00
Xhevahir Mehalla 25 Reputation points
commented 2024-10-04T03:46:36.26+00:00
phemanth 10,325 Reputation points Microsoft Vendor
1 answer

Why is ORDER BY not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?

Hi there, We want to use ORDER BY when creating external table in azure synapse, somehow the ORDER BY does not take effect, may I ask why ORDER BY is not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-02T21:04:57.2966667+00:00
Beifei Zhou 0 Reputation points
commented 2024-10-04T03:28:04.0966667+00:00
phemanth 10,325 Reputation points Microsoft Vendor
1 answer

ADF - converting list of lists into a proper JSON format

Hello, I'm pretty new to ADF and I can't wrap my head around one case. To keep it simple: I have a source (REST API response), which theoretically is JSON but it doesn't have a "proper" JSON format. It's supposed to be a simple table but it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-25T18:29:34.62+00:00
Patryk Sobczak 0 Reputation points
commented 2024-10-04T03:07:17.8066667+00:00
phemanth 10,325 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

Suggest a way to replicate data from on premise sql server 2019 to azure synaspe analytics directly

Im using an sql server in my on premise with version 2019, I need to transfer or replicate real time data to azure synapse database, so which azure service will be more effective and flexible for large data transfer

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,785 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-26T14:30:15.38+00:00
AGP 40 Reputation points
commented 2024-10-03T21:15:47.0133333+00:00
Erland Sommarskog 111.1K Reputation points MVP
1 answer

Passing dynamic parameter to %Run command in Synapse Notebook

So Im doing a test to see if we can dynamically send parameters from a parent notebook to a child notebook Child Notebook: from pyspark.sql import SparkSession from notebookutils import mssparkutils print(f"Storage Account Name:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-10-03T11:36:08.4+00:00
WZIAFP 157 Reputation points
answered 2024-10-03T20:29:46.1866667+00:00
Amira Bedhiafi 24,531 Reputation points
2 answers One of the answers was accepted by the question author.

How to add 100 plus source link in ADF pipeline to transfer data to single destintion.

I need to transfer data from multiple source sql servers( almost 100 plus) to a single destination using ADF, Is there is any way to add these much servers to ADF as source

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,785 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-29T13:21:02.1033333+00:00
AGP 40 Reputation points
accepted 2024-10-03T18:53:06.7366667+00:00
AGP 40 Reputation points
1 answer

Unable to see all the lake database tables in synapse workspace

Hello, I am unable to see the Lake Database tables inside db blade on left side of synapse workspace, only few are visible but rest are not visible but I am able to see them through SSMS and also execute query on them. In fact, these tables are not…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-17T15:34:39.9633333+00:00
Jaya Ojha 60 Reputation points
edited a comment 2024-10-03T18:24:21.22+00:00
Jaya Ojha 60 Reputation points
1 answer

Azure SQL database restore to Synapse

we need to do restore sql server database from restore point to dedicated sql pool on synapse on same resource group we are trying to do restore azure sql server db on same restore group where we have synapse but it ends up with error ERROR1.JPG Command…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,785 questions
asked 2024-09-11T14:01:57.8966667+00:00
Andrea Galardi 0 Reputation points
commented 2024-10-03T16:18:03.0366667+00:00
Molly VanderVelde 51 Reputation points
2 answers

Azure Synapse API returns empty array with filters in POST request, but works without them

I'm trying to query pipeline runs in Azure Synapse using the Synapse REST API (queryPipelineRuns). When I make a POST request without filters in the body, it works and returns the expected pipeline runs. However, when I add filters such as…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
asked 2024-09-28T12:02:25.2366667+00:00
sultan khan 0 Reputation points
commented 2024-10-03T16:00:27.3+00:00
Smaran Thoomu 15,765 Reputation points Microsoft Vendor
2 answers

Creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory

Hi everyone, I’m working on creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory. Here are the steps I’ve taken so far: Copy Data: I’m using the Copy Data activity to get the data into a CSV file. Azure Blob…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,917 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,680 questions
asked 2024-09-16T18:30:01.1433333+00:00
Vaibhav Patil 235 Reputation points
commented 2024-10-03T06:50:27.26+00:00
AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee