Json – How to use `select` within a jq –stream command?
I have a very large json document (~100 GB) that I am trying to use jq to parse out specific objects that meet a given criteria. Because it is so large, I won't be able to read it into memory,…
how to merge multiple json files with same structure into one json file with same structure (combined all into one with keeping same structure))
I need to merge file1.json file2.json (could be more) into onefile.json. version is always the same value in all files. however vulnerabilities array and dependency_files array values different but there might be duplicate/which I want to remove if any after…
Json – jq – unnest/unwind object with array, i.e. make new object for every item in nested array
I am not sure if the operation name is proper here, but the example should show well my intention. This is exactly how unwind aggregation operation in Mongo or unnest in BigQuery behave. Having that json structure: [ { "root-array-a":…
Json – jq – remove duplicates from arrays
i want to remove the duplicates from each array in this json: { "abc": [ "five" ], "pqr": [ "one", "one", "two", "two", "three", "three", "four", "four" ], "xyz": [ "one", "one", "two", "two", "four" ] } output I am…
jq regex test() selecting unexpected values
I am trying to parse the JSON from aws ecr describe-images, and return a result with a specific image tag, matching a pattern, from the list. In particular I get an array with many of these entries: { "imageDetails": […
Override json file values with environment variables docker
Assume that I've a complex json file that is used to configurate my project. Like the json below: { "apis": { "payment": { "base_url": "https://example.com/" }, "order": { "base_url": "https://example.com/" }, }, "features": { "authentication": { "authProviders": true, "registration": false…
AWS CLI filtering with JQ
I'm still trying to understand how to use JQ to get what I want. I want to get the size of all snapshots in my account older than a specific date and then add them up so that I can…
Change entry in json file that matches the condition in CloudFront Update Distribution
We have a scenario where we need to replace the TargetOriginID of CacheBehaviour in the distribution of a json file. We need to replace the Existing TargetOriginID with New Values. I have tried with below jq command but not getting…
How to Iterate Json key value pair and get the value and store in another json using Bash Script with JQ utility – Amazon web services
Im writing bash script for AWS Secret Manager . Question: I have one aws secret manager it will contain multiple secret Example: aws secretsmanager get-secret-value --secret-id Example | jq -r ".SecretString" input.json {"Username":"admin","Password":"admin","Endpoint":"localhost","DatabaseName":"example","Port":"3306"} Using this command got a json output…
jq, getting an unknown parent node after finding it with one of its children value – Ubuntu
I have a complex (at least for me) issue with jq, and this structure : { "os": { "ubuntu": { "16.04": { "codename": "xenial", "bootstrap": "preseed", "guest_type": "ubuntu64Guest", "iso_name": "ubuntu-16.04.7-server-amd64.iso", "iso_checksum": "9bb30a2ea6466b0c02aacfa96f6e3516", }, "18.04": { "codename": "bionic", "bootstrap": "preseed", "guest_type":…