Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,653 questions
1 answer
Did Azure stop support or adding features to Azure Synapse Studio?
Hello Azure Support Team and Azure experts, I am writing to express my concern regarding the current state of Azure Synapse Studio. As a dedicated user of this service, I have noticed that there have been no significant updates or new features added to…
asked 2024-07-08T21:52:32.84+00:00
Alimardon Aliyev
0
Reputation points
commented 2024-07-11T11:10:36.0933333+00:00
phemanth
8,480
Reputation points Microsoft Vendor
0 answers
Getting connection issue while connecting to Synapse Dedicated pool from Notebook using Linked Service
I am using the Linked service with spn and certificate and test connection is successful. But when I use the same linked service in Synapse Notebook getting below error. linked service is created for Synapse Analytics and same is working if I change to…
asked 2024-07-08T05:00:54.1133333+00:00
Venkateswarlu Pottapalli
0
Reputation points
commented 2024-07-11T07:57:50.3833333+00:00
PRADEEPCHEEKATLA-MSFT
84,936
Reputation points Microsoft Employee
2 answers
installing wheel packages on spark pool - Synapse DEP enabled workspaces
Hi, I have a Synapse workspace with DEP enabled, and since PyPI libraries cannot be installed directly in the Spark pool, I want to install azure-mgmt-kusto and azure-kusto-data on the pool. I tried the following methods but encountered the error…
asked 2024-07-05T23:13:00.32+00:00
Abhiram Duvvuru
231
Reputation points Microsoft Employee
answered 2024-07-11T07:56:36.3066667+00:00
PRADEEPCHEEKATLA-MSFT
84,936
Reputation points Microsoft Employee
0 answers
Custom logging in Azure Synapse Datapipeline to to log analytics Workspace - Help Requested
Requirement:- Want to add custom logging in azure synapse pyspark job using python logging module and spark config Getting error while implementing the same in the pyspark job ModuleNotFoundError: No module named 'pyspark.SparkConf pyspark script for…
asked 2024-06-26T23:18:27.1633333+00:00
Johny Yagappan
20
Reputation points
commented 2024-07-11T07:25:52.6166667+00:00
PRADEEPCHEEKATLA-MSFT
84,936
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Unable to Clone Synapse Serverless SQL Database
I'm trying to clone a Synapse Server less SQL database for testing purposes, but I can't find a "Clone" option when I right-click on the database in Synapse Studio. I checked the Microsoft documentation for cloning Synapse databases, but it…
asked 2024-07-09T14:01:08.92+00:00
MulluriNivas-6816
60
Reputation points
accepted 2024-07-11T06:49:45.2466667+00:00
MulluriNivas-6816
60
Reputation points
2 answers
How to create sha256 signature for Oracle Cloud integration Rest API ?
Hi Experts, Infra: Azure Synapse -we are using pipelines / API method to get data and create a Data Warehouse. Source: We have an Oracle Cloud Infrastructure (OCI ) as source , that will output the report to Oracle Cloud Storage. OCI has a REST API…
asked 2024-07-04T03:27:38.67+00:00
Caniut Alex
0
Reputation points
edited a comment 2024-07-11T05:52:03.3566667+00:00
Smaran Thoomu
12,355
Reputation points Microsoft Vendor
0 answers
Synapse custom event trigger publish is not happening on event grid with master branch
Hi all, I have requirement to trigger synapse pipeline when I publish event on event grid. Without git integration when I configure the Trigger and click on publish button, subscription is appearing on Event grid and trigger is working fine. With git…
asked 2024-07-04T07:51:20.4733333+00:00
Madhu Challapalli
20
Reputation points
edited a comment 2024-07-11T05:51:59.29+00:00
phemanth
8,480
Reputation points Microsoft Vendor
0 answers
Sparkpool library Error for adding a zen-engine 0.22.0 in requirement.txt
Hi, PySpark version: 3.3.1.5.2.20240522.3 Python version: 3.10.6 | packaged by conda-forge | (main, Aug 22 2022, 20:35:26) [GCC 10.4.0] I am getting an error when adding zen-engine in requirements.txt in sparkpool in azure synapse spark pool. The…
1 answer
Is there an outage in UK South affecting Azure Synapse Analytics?
At around 10am (BST), our Azure Synapse Analytics pipelines started failing with the following error message: Operation on target Copy data failed: Failure happened on 'Source' side.…
asked 2024-07-10T10:15:00.4666667+00:00
James Neville
0
Reputation points
commented 2024-07-11T04:02:53.9666667+00:00
Nandan Hegde
30,951
Reputation points MVP
0 answers
synapse dataframe writing to oracle with JDBC never quits though it has finished writing. It results into a pipeline failure. sometimes similar code works fine.
Py4JJavaError: An error occurred while calling o4089.save. : java.sql.SQLRecoverableException: IO Error: Connection reset by peer at oracle.jdbc.driver.T4CConnection.logoff(T4CConnection.java:1050) at…
asked 2024-07-09T15:26:35.2066667+00:00
Saini, Vijyant
0
Reputation points
commented 2024-07-10T23:29:03.6466667+00:00
BhargavaGunnam-MSFT
28,931
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Write back to Dataverse from Synapse
Hi, I know we can pull data from Dataverse to Azure Synpse through pipelines. Is its possible to write back to Dataverse from Pipelines or Spark notebook? I didnot see any documentation showing writing back to Dataverse. Thanks, Arun
asked 2024-07-10T20:46:25.0466667+00:00
Kumar, Arun
336
Reputation points
answered 2024-07-10T23:05:43.42+00:00
BhargavaGunnam-MSFT
28,931
Reputation points Microsoft Employee
0 answers
How to read data from blob storage using Linked Service token in Synapse
Hello, I am trying to use Linked Service token to read from an azure blob storage (NOT AZURE DATA LAKE STORAGE GEN2) in a Synapse Notebook, I created a linked Service and test the connection and it was succesfull but when I am trying to read using spark…
1 answer
One of the answers was accepted by the question author.
Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.
Dear Support, I am receiving the following error when running a SQL Query on a Synapse Serverless Pool. Can you assist. thank you. Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time.…
1 answer
App could not could not connect to Azure Synapse when created via ARM template - SSL connection could not be established
Hello. I need your help with smth that we find a difficult to resolve. Here's the current setup: I have created an Azure Synapse workspace using ARM templates. All is working well apart from when an App which has been build on Angular could not connect…
asked 2024-06-21T07:56:17.4333333+00:00
Xhevahir Mehalla
140
Reputation points
commented 2024-07-10T15:14:57.41+00:00
Smaran Thoomu
12,355
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Issue with running queries on Synapse SQL Endpoint - This query cannot be executed because we can't get enough capacity for optimal performance in time.
Dear Community, I am getting the error ""This query cannot be executed because we can't get enough capacity for optimal performance in time."" when running a query using a SQL Serverless endpoint in Synapse Analytics This error…
6 answers
CosmosDB Analytical store delete changes in sql sink
Hi I am trying to capture delete changes from Azure cosmosdb analytical store using change data capture in Azure datafactory, Source is Cosmosdb, sink is Azure sql database. In between I am flattening my file using dataflow. My insert, update is…
asked 2024-04-30T13:52:46.2133333+00:00
Kuldeep Bhati
0
Reputation points
answered 2024-07-10T12:16:09.6333333+00:00
Kuldeep Bhati
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Data tranformation with third party tool
Hi friends, due to cost considerations we are considering data transformation third-party tools, particularly the DBT tool, I want to know the security and data privacy perspective. What security risks, and implications do we have using the DBT tool, and…
1 answer
One of the answers was accepted by the question author.
Azure DevOps pipeline suddenly start failing!
2024-07-09T23:11:19.7718791Z Complete getting Artifacts From Template 2024-07-09T23:11:19.7719155Z Start deploying artifacts from the template. 2024-07-09T23:11:19.7722609Z Deploy dev_keyVault_linkedService of type…
asked 2024-07-09T23:45:33.4466667+00:00
Sultan Khan
20
Reputation points
commented 2024-07-10T08:22:46.3366667+00:00
Sultan Khan
20
Reputation points
0 answers
synapse notebook
Hi , how we can add link services created in synapse in notebook available azure synapse link servicename :test2 select * from test1.table1
2 answers
One of the answers was accepted by the question author.
Migration to Azure
Hi friends, we have a requirement to Migrate Denodo to Azure, and I have these questions: What could be the challenges we can anticipate and be aware of? Does the data's size impact the migration's complexity and duration? What tools are the best suited …