Per the azure docs, VM and cluster size: Streaming ingestion performance and capacity scales with increased VM and cluster sizes. The number of concurrent ingestion requests is limited to six per core. My current setup is as follows: I have…
I have an Azure Data Explorer (ADX) aka. Kusto instance in combination with a PostgreSQL Flexible Server (16.4) and want to access a the SQL table test_adx_meta from ADX. There are no firewall or IP range limitations. I followed the…
I've got an issue that I cannot make sense of. The objective for us is pretty straightforward: We have an ADLS Gen2 storage account that has JSON files stored on it We have a Fabric Eventhouse (KQL) database setup We…
I hope somebody can help me with a tricky Kusto query. I have the following dataset, which contains events raised by user, where events are represented with event code: datatable(CreatedDate:datetime, User:string, EventCode:string) [ datetime(4-22-2024 12:44:02.750 PM), "user1", "TS", datetime(4-23-2024 4:09:30.551…
There are common ways to handle dup data as described Here But I'm looking for more options. Thanks I have tried the options from here https://learn.microsoft.com/en-us/azure/data-explorer/dealing-with-duplicates and was looking into unique hashed row approach or a policy which triggers the…
I've got a KQL query, and I want to strip out the last row of data. However, the number of rows returned is variable, so I can't use take (aka limit) because I don't know what number to pass it.…
I have an ADF pipeline to copy data from ADLS to Data Explorer(ADX). I am reading all the data and able to copy to ADX. Problem is that every time my pipeline runs and ingest data the ADX table gets…
I am using lightIngest to ingest data from my blob in Azure to Azure Data Explorer. I am having the Storage Blob Data Reader role assignment under my Azure Data Explorer Cluster. I am able to read and list the…
in the Pipeline Expression builder I want to run one command to ingest data into different tables. How is that possible? Below would be two commands who would work on its own, but I want to combine them and run…
Given Kusto query Table | where type == "TYPE" | summarize lastEventTime = arg_max(lastEvent, *), vmCount = count(), onboardedCount = countif(onboarded), failVM = make_list_if(entity, onboarded == false and isnotempty(entity)), allVM = make_set(entity) by environmentType, osType, id , type Now I…