I have a snippet of JSON file that I normalize and use record_path on with the meta parameters on other columns and it works fine, but when I load the whole file I get a key error. Below is my…
I was wondering why I get a key error when i use record_path on this data set. It comes from the FDA api and I grabbed the first two results. data = { "meta": { "disclaimer": "Do not rely on…
I'm trying to add a timestamp column, updated_at, in the updates when doing a upsert using on_conflict_do_update. Below is my current implementation but encounter the below error when running at the last line. Exception has occurred: ProgrammingError (psycopg2.errors.AmbiguousColumn) column reference…
I would like to get all physical addresses in MS-excel from this url [https://www.tamoil.ch/en/store-locator]. The spreadsheet only has a header, but no output from the code. import requests from bs4 import BeautifulSoup import pandas as pd # Send a GET…
I'm working on analyzing some data. I have a way of doing this in excel, but it's slow and too much manual work. I'd like to find a more effective way to find what I'm looking for. Here's the scenario:…
I'm trying to print a pandas dataframe in a cell of a Jupyter Notebook. However, for some reason, the DataFrame is truncated at some point of the line and continues above. Any clue of how to increase the number of…
today i have a modification from another question that i did yesterday. The challenge is: How convert a CSV into a hierarchical json but the keys and values are different. It must be done with PYTHON (pandas and json library)…
I have a csv file that with rows that looks like this: 745198;2024-09-10 10:09:10.7;leaf-2;{"Accelerometer": {"X": 0.055297852, "Y": 0.993530273, "Z": 0.000244141}} 745199;2024-09-10 10:09:10.71;leaf-2;{"Accelerometer": {"X": 0.056274414, "Y": 0.994384766, "Z": 0.000976563}} 745200;2024-09-10 10:09:10.721;leaf-2;{"Accelerometer": {"X": 0.055786133, "Y": 0.994018555, "Z": 0.000854492}} 745201;2024-09-10 10:09:10.732;leaf-2;{"Accelerometer": {"X": 0.055053711,…
Today I have a challenge at my school, it is convert a CSV file to a JSON file. This CSV has a table structure (which means contains the information from an oracle table in this example). So i have to…
I have a .csv log file containing three json lines for each client. For example: {"name":"John","phone":"08847","politic":"on","ville":"LA","isTest":"false","source":"t3_1"} {"data":{"name":"John","phone":"+8847","city":"LA","source":"t3_1","cameF":"a1"},"token":"bd67a","isTest":false} {"data":{"responseId":"R_2hs","city":"LA","cameF":"cpl_agency2","source":"t3_1"},"success":true,"ts":1721394844,"message":null} I don't understand how you can combine three separate lines into one and then read the json. Starting reading the file: import…