I am trying to split 1 NDJSON file into multiple NDJSON files. I am able to consume and split the file, but the problem is the resulting files are in JSON format. Is it possible to output to NDJSON format…
I have a large jsonl file like so: # source.jsonl {"id": "y88979", "content": "content goes here"} {"id": "h93794", "content": "content goes here"} {"id": "k9489", "content": "content goes here"} {"id": "p48947", "content": "content goes here"} {"id": "i8408", "content": "content goes here"}…
I have JSONL file as text - string, its a very big file and not useful to convert to standard JSON: {"id":"gid://shopify/ProductVariant/32620848382088","__parentId":"gid://shopify/Product/4632300847240"} {"id":"gid://shopify/Product/4632300912776"} {"namespace":"daily_deals","key":"status","value":"inactive","__parentId":"gid://shopify/Product/4632300912776"} {"namespace":"daily_deals","key":"endtime","value":"1604966400000","__parentId":"gid://shopify/Product/4632300912776"} {"id":"gid://shopify/ProductVariant/32620848447624","__parentId":"gid://shopify/Product/4632300912776"} {"id":"gid://shopify/Product/4632301011080"} {"namespace":"daily_deals","key":"status","value":"inactive","__parentId":"gid://shopify/Product/4632301011080"} {"namespace":"daily_deals","key":"endtime","value":"1604966400000","__parentId":"gid://shopify/Product/4632301011080"} {"id":"gid://shopify/ProductVariant/32620848808072","__parentId":"gid://shopify/Product/4632301011080"} {"id":"gid://shopify/ProductVariant/39402297720968","__parentId":"gid://shopify/Product/4632301011080"} {"id":"gid://shopify/Product/4673135444104"} I want to solve problem at frontend so…
From the Shopify API, I receive a link to a large amount of JSONL. Using NodeJS, I need to read this data line-by-line, as loading it all at once would use lots of memory. When I hit the JSONL url…