synapse analytics deployment error
I'm using my student account which gives $100 creidt. {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…
Sending Pipeline Failure Alerts via Logic App in ADF
How can a pipeline failure alert be sent via a Logic App when an activity fails in Azure Data Factory? I'm trying to extract the error message to send it via email using the following pipeline expressions: 1. @concat('Target: ',…
Serverless SQl pool has encountered an internal error
Hi all, I am getting this error while trying to run a simple query on an csv file connected to azure synapse studio via linked service; Serverless SQl pool has encountered an internal error Below is the error message from synapse studio. I did google…
Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.
Hi Support, I have the issue with the queries that I use everyday without any problem. However, today it shows this message. [This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent…
Synapse notebooks are not using overriden spark resources configured with %% configure
We are trying to override default settings for synapse spark notebooks which used very fat configbfor executor memory/cores etc using magic commands like this, but when notebook is getting executed it still demands 12vcores and gives out of quota error…
Azure Synapse Google Ads LinkedService
I was trying to create a linked service to a Google Ads account. I have obtained the Google Developer token through Google Ads and created a Google API project with Google Ads API. But I am getting the below error when testing the linked service. ERROR…
AZURE SYNAPSE ANALYTICS SQL POOL SERVERLESS is unavailable
Hello, Suddenly, from this morning, I cannot execute a sql request on my Azure Synapse Analytics. Indeed the SQL POOL SERVERLESS is unavailable (internal error). I have no detail and I have the same problem in my 2 environments (devlopement and…
Executing a synapse pipeline from a synapse notebook with parameter
Hello I'm currently working on executing a synapse pipeline directly from a synapse notebook and was wondering if there's a method to achieve this. Additionally, the synapse pipeline I'm working with requires specific parameters to function correctly.…
Can't get template-parameters-definition.json to expose Synapse parameters
Hello. I am new to this so please go easy. I want to be able to customise a couple of parameters when I deploy my Synapse workspace artifacts to another environment. I understand the way to do this is the template-parameters-definition.json in the…
Sending data frame as an attachment in email using synapse notebook (PySpark)?
Hello, Is it possible to send pyspark dataframe as an attachment in email using synapse notebook (PySpark)? Thanks
We have a requirement to export Oracle cloud fusion data to azure datalake at a monthly cadence. We are able to use rest connector, but getting error with Oracle service cloud connector
Synapse Oracle Service Cloud (Preview) Connector form synapse is giving following error when using hostname in following format <>.<>.ocs.oraclecloud.com as specified in documentation and get following error . ERROR [HY000]…
Synapse Serverless SQL external table returns old data
An external table created in a Synapse Serverless SQL pool for an Azure Storage account Delta Table is not showing the data as it is in the Delta table. When the external table was initially created the data in the table was incorrect. The decision was…
Synapse Workspace Common Data Model
Hi Team, We were referring to the database templates provided for common data model. We wanted to get the entities and attributes related to Supply chain and were unable to find the same. There Git repo seems to have a different set of entities. E.g.,…
Sending data frame as an attachment in email using synapse notebook (PySpark)?
Hello, Can you please share if there is any documentation on How to send data frame as an attachment (csv or text) in email using synapse notebook? Is this possible or any limitations? Thanks
Encrypt data on transit - Oracle OCI to Azure Synapse -
Hello - We are implementing a solution like this: Extract data from Oracle OCI database use Azure Synapse Analytics Store Data to Data lake gen 2 We have created linked service in Synapse to connect to oracle OCI db We have been asked how to make…
Why is ORDER BY not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?
Hi there, We want to use ORDER BY when creating external table in azure synapse, somehow the ORDER BY does not take effect, may I ask why ORDER BY is not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?
ADF - converting list of lists into a proper JSON format
Hello, I'm pretty new to ADF and I can't wrap my head around one case. To keep it simple: I have a source (REST API response), which theoretically is JSON but it doesn't have a "proper" JSON format. It's supposed to be a simple table but it…
Suggest a way to replicate data from on premise sql server 2019 to azure synaspe analytics directly
Im using an sql server in my on premise with version 2019, I need to transfer or replicate real time data to azure synapse database, so which azure service will be more effective and flexible for large data transfer
Passing dynamic parameter to %Run command in Synapse Notebook
So Im doing a test to see if we can dynamically send parameters from a parent notebook to a child notebook Child Notebook: from pyspark.sql import SparkSession from notebookutils import mssparkutils print(f"Storage Account Name:…
How to add 100 plus source link in ADF pipeline to transfer data to single destintion.
I need to transfer data from multiple source sql servers( almost 100 plus) to a single destination using ADF, Is there is any way to add these much servers to ADF as source