Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
525 questions
1 answer
Allowed operator in Azure Data Explorer RLS function
I'm attempting to implement RLS in ADX on already ingested data. The RLS policy function I'm creating looks like this. .create-or-alter function with (docstring = 'Restricts access to data.', folder = 'RLS') RestrictAccess(TableName: string) { …
asked 2024-09-26T10:33:04.77+00:00
AdamRnarsson-2213
0
Reputation points
commented 2024-10-03T19:05:30.51+00:00
Chandra Boorla
1,730
Reputation points Microsoft Vendor
0 answers
Return rows that only have nulls?
I'm using Kusto/KQL. I have a huge dataset that I am working with that was migrated from another sources. I know that many of the fields only have null values. I'd like to be able to identify those columns. Sort of doing a null check on column by column,…
asked 2024-10-03T17:31:07.81+00:00
John Thoni
0
Reputation points Microsoft Employee
asked 2024-10-03T17:31:07.81+00:00
John Thoni
0
Reputation points Microsoft Employee
0 answers
ODBC uses service principal to connect to ADX
Hi, we're trying to let ODBC uses azure service principal to connect to ADX but encounters the error Error requesting access token The reference guide is this : https://learn.microsoft.com/en-us/azure/data-explorer/connect-odbc The client is…
asked 2021-10-19T05:39:42.39+00:00
Amy Z
296
Reputation points
edited a comment 2024-10-02T13:39:06.63+00:00
Weber, Christian
0
Reputation points
0 answers
ADX Transactional Update Policy Guarantees
The update policy documentation for Azure Data Explorer makes the following statements about transactional update policies (these statements are inconsistent with each other): "guarantees consistency between data in the source and target…
asked 2024-03-08T15:53:20.1633333+00:00
Alex Lorimer
0
Reputation points
commented 2024-09-27T16:05:37.83+00:00
Alex Lorimer
0
Reputation points
2 answers
One of the answers was accepted by the question author.
Intermittent Error with Materialized View in Kusto: "Index was outside the bounds of the array"
Hello, I'm encountering an issue with a materialized view in Kusto where I sometimes get an error when querying the view. Below is my materialized view definition: // materialized-views .create async materialized-view with (backfill=True,…
asked 2024-09-26T07:29:33.0666667+00:00
Wes Verhagen
50
Reputation points
accepted 2024-09-27T10:03:09.8833333+00:00
Wes Verhagen
50
Reputation points
1 answer
One of the answers was accepted by the question author.
how to delete a table in azure data explorer using kql query?
I was trying to delete a table called Heartbeat from Azure Data Explorer DB using a KQL script. The contents of the kql script is: .drop table Heartbeat ifexists On executing the kql script using github workflows, Im getting the following error: The…
asked 2023-11-24T12:40:50.0566667+00:00
PRIYANKA S NAIR
40
Reputation points
accepted 2024-09-25T10:49:37.15+00:00
PRIYANKA S NAIR
40
Reputation points
1 answer
How materialized views work in Azure Data Explorer regarding cache policy?
Hey everyone, I am trying to implement some materialized views within my ADX cluster. I need to backfill the data for the last year and I understood that I must increase my hot cache policy for it to be able to. I have two questions regarding that: is it…
asked 2024-09-18T14:43:32.8866667+00:00
Marcos Olmedilla
0
Reputation points
commented 2024-09-20T17:17:37.1933333+00:00
Smaran Thoomu
15,685
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
How to access the databases and their tables while executing the KQL query at the cluster level?
i want to access the databases and their tables at the cluster connection level how can i achieve that?
asked 2024-08-12T11:36:43.82+00:00
Muhammad Usman Rafiq
20
Reputation points
accepted 2024-09-20T06:52:12.04+00:00
Muhammad Usman Rafiq
20
Reputation points
1 answer
Does the Managed Identity on GitHub action work with Delta-Kusto to connect ADX?
I'm working on a KQL scripts repo in GitHub and using Delta-Kusto (https://github.com/microsoft/delta-kusto) to implement CI/CD to ADX. Currently, I'm using a Service Principle to connect ADX and deploy, but I'm curious if there's a way to use Managed…
asked 2024-09-13T21:38:37.6866667+00:00
Dhinesh Sornakili
0
Reputation points
commented 2024-09-17T06:06:18.2766667+00:00
PRADEEPCHEEKATLA-MSFT
89,296
Reputation points Microsoft Employee
1 answer
Kusto Load Balancer
Hi, Is it possible to setup a load balancer in front of two Kusto clusters. Could you please let me know if this is feasible and what steps would be involved in implementing such a setup? Your guidance on this matter would be greatly appreciated. Thanks
asked 2024-08-09T18:40:58.83+00:00
Shiva Lakshman Nallakatta
0
Reputation points Microsoft Employee
edited an answer 2024-09-16T12:00:27.4333333+00:00
Sander van de Velde | MVP
32,556
Reputation points MVP
1 answer
Best data architecture strategy in Azure Data Explorer
Hey everyone, I have some questions regarding the best pracetices for the data architecture within Azure Data Explorer. We currently have multiple databases with similar telemetry data in tables from multiple clients. We would like to do some…
asked 2024-09-06T12:09:54.3133333+00:00
Marcos Olmedilla
0
Reputation points
commented 2024-09-10T16:14:13.56+00:00
NIKHILA NETHIKUNTA
2,395
Reputation points Microsoft Vendor
1 answer
An admin command cannot be executed temporarily due to an internal state transition
We have an ADX cluster with two instances and java service querying external tables using jdbc sql driver. We ran a performance test, more than 3k requests. We saw many db query errors with this message: An admin command cannot be executed…
asked 2024-05-31T22:51:48.55+00:00
_Esteban Bett
35
Reputation points
commented 2024-09-02T08:52:28.51+00:00
Ori Bandel
30
Reputation points
1 answer
YAML migration for Azure-Kusto query
I'm trying to trigger a gate check in YAML, this is what I have so far, with the sensitive bits removed. What is wrong with this snippet? I'm getting the following error - Encountered error(s) while parsing pipeline YAML:…
asked 2024-08-29T18:01:49.9233333+00:00
Abhay Punjabi
0
Reputation points Microsoft Employee
answered 2024-08-30T11:17:14.1466667+00:00
phemanth
10,330
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Separate data in data explorer and use as datastore
Hello, We are sending data from IoT Central to Event Hubs and then to Data Explorer, with the hopes of then sending the data to Azure Machine Learning. In order to send data from Event Hubs to Data Explorer it needs a data ingestion into a table…
2 answers
E_LOW_MEMORY_CONDITION Query Execution lacks memory resource to complete (message: bad allocation)
Hi all, I'm new to ADX and I need your support. I used to use this query a week ago and it went well both in ADX and PBI but somehow it shows an error today as attached in PBI (in ADX is still working). Here is the query I used for reference. let T1 =…
asked 2024-08-26T04:56:33.5466667+00:00
Sangsattaya, Manatsanan
0
Reputation points
answered 2024-08-26T10:10:00.63+00:00
phemanth
10,330
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Azure Data Explorer - PostgreSQL plugin - Entra ID support
I am working on integrating Postgres DB with ADX - I want to use the external table plugin. I see that currently the only authentication method supported is Username and Password. Is there planned adding EntraID support for the PostgreSQL plugin? Thanks…
asked 2024-08-21T09:50:30.87+00:00
JAGODZINSKI Tomasz
20
Reputation points
edited a comment 2024-08-22T11:13:34.84+00:00
PRADEEPCHEEKATLA-MSFT
89,296
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Should I worry about a high number of extents?
Hello ADX experts. I am currently doing a POC to see if ADX will work for us. So far I enjoy the ADX developer experience. Since I haven't found a clear recommendation for how to partition my table, I have created two tables where I ingest identical…
asked 2024-08-12T22:02:28.9333333+00:00
Pål Kristian Halle
65
Reputation points
commented 2024-08-14T13:18:37.8433333+00:00
Pål Kristian Halle
65
Reputation points
1 answer
How to add external Cache in Azure data explorer?
Currently, I have two instances of the "Standard_E8ads_v5" SKU, with CPU utilization ranging between 40% and 60%. However, the cache utilization is at 100%, and this is causing slow load times for cold cache data. I need to increase the CPU…
asked 2024-08-02T12:09:24.9866667+00:00
Shubham Jaunjal
0
Reputation points
commented 2024-08-13T20:23:43.94+00:00
Sander van de Velde | MVP
32,556
Reputation points MVP
2 answers
One of the answers was accepted by the question author.
Is there a better way to stream data?
Hello Support, We currently have a system where there are 10 devices per iot hub, and each of those devices are routed to their own event hub. From there they are ingested and streamed in ADX, each having there own table in the database. I tried using…
asked 2024-08-07T01:38:29.9633333+00:00
Nathan Sommer
40
Reputation points
accepted 2024-08-08T23:33:24.1766667+00:00
Nathan Sommer
40
Reputation points
2 answers
One of the answers was accepted by the question author.
Kusto table not being detected by ADF Copy Data activity
Hello, I am creating a pipeline in Azure Data Factory that uses a Scope activity to generate some data and uses a Copy Data activity to push that data to Kusto. I manually created a table in Azure Data Explorer with the Schema alongside a new dataset…