1,604 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer One of the answers was accepted by the question author.

Import A website data as a table in ms fabric

i have a website i want to import as table and store in the datalake . its possible in power bi we can see as a table view, please give me a solution for this

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-07-14T08:58:30.28+00:00
shafeeq pk 0 Reputation points
edited the question 2024-07-15T02:58:39.5666667+00:00
PRADEEPCHEEKATLA-MSFT 84,941 Reputation points Microsoft Employee
2 answers One of the answers was accepted by the question author.

synapse dedicated pool database size

What is the right way to find the database size, table's size, and other objects, the db size that is being billed by azure? Also where can be find the space occupied by the external tables(meta data)?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-01-19T06:31:06.9466667+00:00
Vinodh247 12,831 Reputation points
commented 2024-07-14T14:25:01.9066667+00:00
Sharma, Rahul 80 Reputation points
2 answers One of the answers was accepted by the question author.

Want to migrate from one Synapse workspace to another Synapse workspace

Hi team, Want to migrate from one Synapse workspace to another Synapse workspace. One being Dev environment, another one test environment. Please provide leads. Regards, NagaSri

Azure Database Migration service
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,418 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,059 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2021-10-18T15:17:49.867+00:00
Naga 66 Reputation points
answered 2024-07-12T15:07:38.5833333+00:00
Mehdi Belkhiria 0 Reputation points Microsoft Employee
5 answers One of the answers was accepted by the question author.

Synapse Analytics Event Trigger Activation Error

Storage event trigger activation fails with following error: Forbidden. Role based access check failed for resource <storage-account> Please help.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2020-08-18T16:33:47.047+00:00
Chavi Gupta 36 Reputation points
edited a comment 2024-07-12T07:17:57.1466667+00:00
Venki Bimma 0 Reputation points
2 answers One of the answers was accepted by the question author.

Missing ODBC drivers on spark 3.3 & 3.4 version

Hi Team - We are upgrading our Spark version from 3.2 to 3.4 and using the pyodbc module for SQL operations. However, we are encountering the following error when attempting to connect to the Azure SQL Database. Could someone please assist…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-07-05T20:55:19.18+00:00
Abhiram Duvvuru 231 Reputation points Microsoft Employee
accepted 2024-07-11T23:22:57.3733333+00:00
Abhiram Duvvuru 231 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

check a field value is not null in derived transformation in dataflow

I am checking if a field(column) has data that is not NULL. How do i use NOT ISNULL(field1) in derived transformation ? I want to convert following code in derived transformation example: iif( not isNULL(field1), field1, iif( not isnull(field2), field2,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-07-09T17:16:30.26+00:00
Peruka, Sikander reddy 90 Reputation points
accepted 2024-07-11T15:49:02.5133333+00:00
Peruka, Sikander reddy 90 Reputation points
1 answer One of the answers was accepted by the question author.

Reached the maximum number of Synapse workspaces for Azure Students

Reached the maximum number of Synapse workspaces allowed for this subscription. Please contact Microsoft support to request an exception. Subscription: ededc91b-601b-4aa9-bae1-df7da64b1d65. Subscription offer type: AzureForStudents_2018-01-01. Current…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-01-11T17:21:45.0633333+00:00
Nori 35 Reputation points
commented 2024-07-11T11:19:00.5733333+00:00
Scott Tarvan 0 Reputation points
1 answer One of the answers was accepted by the question author.

Unable to Clone Synapse Serverless SQL Database

I'm trying to clone a Synapse Server less SQL database for testing purposes, but I can't find a "Clone" option when I right-click on the database in Synapse Studio. I checked the Microsoft documentation for cloning Synapse databases, but it…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-07-09T14:01:08.92+00:00
MulluriNivas-6816 60 Reputation points
accepted 2024-07-11T06:49:45.2466667+00:00
MulluriNivas-6816 60 Reputation points
2 answers One of the answers was accepted by the question author.

Write back to Dataverse from Synapse

Hi, I know we can pull data from Dataverse to Azure Synpse through pipelines. Is its possible to write back to Dataverse from Pipelines or Spark notebook? I didnot see any documentation showing writing back to Dataverse. Thanks, Arun

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-07-10T20:46:25.0466667+00:00
Kumar, Arun 336 Reputation points
answered 2024-07-10T23:05:43.42+00:00
BhargavaGunnam-MSFT 28,931 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.

Dear Support, I am receiving the following error when running a SQL Query on a Synapse Serverless Pool. Can you assist. thank you. Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-07-10T10:01:27.9+00:00
Doug 55 Reputation points
commented 2024-07-10T15:51:49.59+00:00
Doug 55 Reputation points
2 answers One of the answers was accepted by the question author.

Issue with running queries on Synapse SQL Endpoint - This query cannot be executed because we can't get enough capacity for optimal performance in time.

Dear Community, I am getting the error ""This query cannot be executed because we can't get enough capacity for optimal performance in time."" when running a query using a SQL Serverless endpoint in Synapse Analytics This error…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-06-28T13:28:40.9133333+00:00
Doug 55 Reputation points
commented 2024-07-10T13:21:44.2166667+00:00
Doug 55 Reputation points
2 answers One of the answers was accepted by the question author.

Data tranformation with third party tool

Hi friends, due to cost considerations we are considering data transformation third-party tools, particularly the DBT tool, I want to know the security and data privacy perspective. What security risks, and implications do we have using the DBT tool, and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-07-10T06:43:41.57+00:00
Anshal 2,166 Reputation points
accepted 2024-07-10T12:08:40.73+00:00
Anshal 2,166 Reputation points
1 answer One of the answers was accepted by the question author.

Azure DevOps pipeline suddenly start failing!

2024-07-09T23:11:19.7718791Z Complete getting Artifacts From Template 2024-07-09T23:11:19.7719155Z Start deploying artifacts from the template. 2024-07-09T23:11:19.7722609Z Deploy dev_keyVault_linkedService of type…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-07-09T23:45:33.4466667+00:00
Sultan Khan 20 Reputation points
commented 2024-07-10T08:22:46.3366667+00:00
Sultan Khan 20 Reputation points
2 answers One of the answers was accepted by the question author.

Migration to Azure

Hi friends, we have a requirement to Migrate Denodo to Azure, and I have these questions: What could be the challenges we can anticipate and be aware of? Does the data's size impact the migration's complexity and duration? What tools are the best suited …

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,418 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-07-08T14:32:15.9266667+00:00
Anshal 2,166 Reputation points
accepted 2024-07-10T06:45:47.0066667+00:00
Anshal 2,166 Reputation points
1 answer One of the answers was accepted by the question author.

Can I create external views in synapse from multiple data sources?

Hi, I have data from different azure regions and my idea to decrease overhead is to use just synapse workspace with multiple external data sources and create the external tables for each of them, since I can't put all the data into a same location for…

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,897 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-07-10T00:58:48.06+00:00
Gustavo Adolfo Alemán Sánchez 60 Reputation points
accepted 2024-07-10T06:19:24.84+00:00
Gustavo Adolfo Alemán Sánchez 60 Reputation points
1 answer One of the answers was accepted by the question author.

Static Code Analysis for ADF or Synapse Pipelines in Azure

Hi team, I would like to know is there any use case possible to perform static code analysis of our ADF or Synapse pipelines residing in Azure DevOps repository? Thanks, Debajit Mitra

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,077 questions
asked 2024-06-14T03:42:29.93+00:00
Debajit Mitra 20 Reputation points
accepted 2024-07-10T04:04:11.9866667+00:00
Debajit Mitra 20 Reputation points
2 answers One of the answers was accepted by the question author.

Extracting Purchaser Data from Azure Synapse for Marketing Automation

I'm looking to connect Azure Synapse Analytics with a marketing automation platform. My goal is to identify recent purchasers from my existing Azure Synapse data and send them targeted emails using the marketing platform. While I can handle sending…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-07-04T09:11:47.34+00:00
vikranth-0706 200 Reputation points
accepted 2024-07-09T05:17:32.1633333+00:00
vikranth-0706 200 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Synapse LinkConnection template json

We have created a LinkConnection in Azure synapse, the source database is MS SQL Server and target database is Dedicated SQL Pool. We are trying to create powershell script to automate the creation of this LinkConnection for each environment - Testing,…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Automation
Azure Automation
An Azure service that is used to automate, configure, and install updates across hybrid environments.
1,184 questions
PowerShell
PowerShell
A family of Microsoft task automation and configuration management frameworks consisting of a command-line shell and associated scripting language.
2,288 questions
asked 2024-07-03T19:21:58.6166667+00:00
Girish Prabhudesai 41 Reputation points
accepted 2024-07-08T11:30:36.9633333+00:00
Girish Prabhudesai 41 Reputation points
1 answer One of the answers was accepted by the question author.

How to install com.crealytics.spark.excel to Synapse Spark Pool

Hello, I have spark pool with following properties: According to the instruction mentioned under the Q&A https://learn.microsoft.com/en-us/answers/questions/1185314/how-to-write-data-from-notebook-to-dedicated-sql-p?cid=kerryherger I have…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-06-26T14:34:57.57+00:00
Tamashevich, Tatsiana 60 Reputation points
accepted 2024-07-08T10:20:43.0566667+00:00
Tamashevich, Tatsiana 60 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Synaps serverless scan file that should be filtered

Hey, We have a large amount of files stored in Storage Account in Parquet format with the following hierarchy. /m_id=%M_ID%/quarter=%QUARTER%/month=%MONTH%/partition_version=last/part-0.parquet'. examples for quarter values: 2024Q1, 2024Q2, 2024Q3…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
asked 2024-07-01T08:48:06.6533333+00:00
Shlomi Lanton 76 Reputation points
accepted 2024-07-08T06:32:50.6833333+00:00
Shlomi Lanton 76 Reputation points