I have a json that is three levels deep. I want to flatten it into a dataframe that has five columns. id name code level parent_id So: The part I struggle with is that I can extract each nested item,…
I have a snippet of JSON file that I normalize and use record_path on with the meta parameters on other columns and it works fine, but when I load the whole file I get a key error. Below is my…
I was wondering why I get a key error when i use record_path on this data set. It comes from the FDA api and I grabbed the first two results. data = { "meta": { "disclaimer": "Do not rely on…
I'm trying to add a timestamp column, updated_at, in the updates when doing a upsert using on_conflict_do_update. Below is my current implementation but encounter the below error when running at the last line. Exception has occurred: ProgrammingError (psycopg2.errors.AmbiguousColumn) column reference…
I would like to get all physical addresses in MS-excel from this url [https://www.tamoil.ch/en/store-locator]. The spreadsheet only has a header, but no output from the code. import requests from bs4 import BeautifulSoup import pandas as pd # Send a GET…
I'm working on analyzing some data. I have a way of doing this in excel, but it's slow and too much manual work. I'd like to find a more effective way to find what I'm looking for. Here's the scenario:…
I'm trying to print a pandas dataframe in a cell of a Jupyter Notebook. However, for some reason, the DataFrame is truncated at some point of the line and continues above. Any clue of how to increase the number of…
today i have a modification from another question that i did yesterday. The challenge is: How convert a CSV into a hierarchical json but the keys and values are different. It must be done with PYTHON (pandas and json library)…
I have a csv file that with rows that looks like this: 745198;2024-09-10 10:09:10.7;leaf-2;{"Accelerometer": {"X": 0.055297852, "Y": 0.993530273, "Z": 0.000244141}} 745199;2024-09-10 10:09:10.71;leaf-2;{"Accelerometer": {"X": 0.056274414, "Y": 0.994384766, "Z": 0.000976563}} 745200;2024-09-10 10:09:10.721;leaf-2;{"Accelerometer": {"X": 0.055786133, "Y": 0.994018555, "Z": 0.000854492}} 745201;2024-09-10 10:09:10.732;leaf-2;{"Accelerometer": {"X": 0.055053711,…
Today I have a challenge at my school, it is convert a CSV file to a JSON file. This CSV has a table structure (which means contains the information from an oracle table in this example). So i have to…