In Polars / pandas I can do a rolling sum where row each row the window is (row - 10 minutes, row]. For example: import polars as pl data = { "timestamp": [ "2023-08-04 10:00:00", "2023-08-04 10:05:00", "2023-08-04 10:10:00", "2023-08-04…
Trying to load a nested JSON file into Duckdb. Here is the JSON contents: { "MainLevel":[ { "More":{ } }, { "More":{ "Level2":[ { "Field1":"A" } ] } } ] } This is the Duckdb SQL script I am using…
I use ansible to select internal details of my hosts and get a large JSON list of the results. I want to see the networking details of every interface on every host in a nice table. Sample JSON: [ {…
I have a table in postgres and basically i'm trying to duplicate rows based on the delimiter @ in the description column. Here is my table: txn_id description 3332654 [email protected]@0.9397@$10.64@[email protected]@23.8235@$6.30@KRW@36,[email protected]@$41.84@[email protected]@1.5711@$12.73@[email protected]@0.6013@$8.32@[email protected]@10.6013@$18.32 3332655 [email protected]@0.8197@$11.64@[email protected]@21.8135@$61.30@KRW@36,[email protected]@$411.84@[email protected]@11.5711@$11.73 Using the below postgresql code, the rows are…
I have some partially columnar data like this: "hello", "2024 JAN", "2024 FEB" "a", 0, 1 If it were purely columnar, it would look like: "hello", "year", "month", "value" "a", 2024, "JAN", 0 "a", 2024, "FEB", 1 Suppose the data…
I would like to write CSV data directly from a bytes (or string) object in memory to duckdb database file (i.e. I want to avoid having to write and read the temporary .csv files). This is what I've got so…
Let assume I have two parquet file aka main and updates with some data as shown below. I need to implement upsert kind of operation in duck db. parquet file main: id, name, city data: id name city 1 a…
Is there a way to convert the result of a SELECT query on a table directly to JSON without writing it to a file? Perhaps with the JSON extension of duckdb? I could also use the python client, where I'd…
I'm running a code written for Snowflake SQL dialect on database with DuckDB(Postgres) dialect. I need to dispatch the functions that do not exist in the target one. For example I have error regarding endswith function - it's available in…
I have an arrow table that I'm trying to query with DuckDB_wasm but I'm getting an error that the table doesn't exist. I have this... const dlURL="http://localhost:7071/api/getdata" const arrowTable = await tableFromIPC(fetch(dlURL)) const c = await db.connect(); await c.insertArrowTable(arrowTable ,…