I'm trying to ingest data from the open-source, public Yahoo Finance API using Azure Data Factory. The endpoint I'm testing is https://query2.finance.yahoo.com/v8/finance/chart/GOLD. I am able to ingest the data but I'm coming up with an issue when trying to transform…
I am trying to query a table in Snowflake that is built with a single field labeled "Value" and each row is a separate JSON object. Row 1: { "artist": { "artistID": "artist_1", "artistName": "Roblox" }, "descriptors": { "styles": […
I am given a matrix with dimensions dim = nxmx4. I would like to flatten this matrix to a new 1-dimensional matrix with length l = n*m*4 using 3 nested for-loops. for (let x = 0; x < n; x++)…
I use R to process log files of zigbee2mqtt which logs entries like this head(data) [1] "info 2024-03-11 14:08:01: MQTT publish: topic 'zigbee2mqtt/TempBadEG', payload '{"battery":17,"humidity":50.1,"linkquality":105,"temperature":17.25,"voltage":2500}'" [2] "info 2024-03-11 14:08:04: MQTT publish: topic 'zigbee2mqtt/MotionBadOben', payload '{"battery":20,"battery_low":true,"illuminance":37914,"illuminance_lux":12369,"led_control":"off","linkquality":69,"occupancy":false,"occupancy_timeout":60,"tamper":false,"temperature":17,"update":{"installed_version":262147,"latest_version":262146,"state":"idle"},"voltage":2600}'" [3] "info 2024-03-11 14:08:04: MQTT…
I have a list of objects : [ { "person": "abc", "city": "united states", "facebooklink": "link", "address": "united states", "united states": [ { "person": "cdf", "city": "ohio", "facebooklink": "link", "address": "united states/ohio", "ohio": [ { "person": "efg", "city": "clevland", "facebooklink":…
I have two array with same key but diff value example : ( "2"=> 6, "5"=> 1 ), ( "2"=> 1, "5"=> 3 ) I want to create new array with the same key but replace highest value like this…
I am learning Snowflake right now, and the way FLATTEN() works is a bit counter intuitive. A simple query. SELECT raw:first_name::STRING AS FName, raw:last_name::STRING AS LName, f.value::STRING AS Skill FROM tbl, TABLE(FLATTEN(raw:Skills)) f ORDER BY raw:id::INT LIMIT 5; Elegantly, it…
I have 2 tables one is category that has subcategories and I want to fetch the records and put in a single array. I have implemented this code: public function searchItem(){ $categories = ServiceCategory::with('subCategories')->get(); $categoryArray = []; foreach ($categories as…
I have a dataframe which has a structure like below. id, name, value, employee_0_salary, employee_0_skills_0_id, employee_0_skills_1_id, employee_1_salary, employee_1_skills_0_id so on.. Basically formed from a flattened json. But the number of columns exceed 1024. I couldn't copy the structure of json…
I hace a big json file data and I want to convert it in to tabular form. I am trying to flatten the data in to dataframe using json_nomalise. so Far I have this : code so far I want…