Question 267236 in Json Question posted in
Our archive of expertly curated questions and answers provides insights and solutions to common problems related to this popular data interchange format. From parsing and manipulating JSON data to integrating it with various programming languages and web services, our archive has got you covered. Start exploring today and take your JSON skills to the next level

Json – Use jq to append array contents from multiple files into one master array

I’m attempting to use jq to combine the data of many JSON files. However, most solutions I tried clobber the data and I end up losing most of it.

Each file looks something like this

{
  "Brand":"brand",
  "Fulfilled":5600,
  "Total":5626,
  "Data":[
    {
      "data":"data1"
    },
    {
      "data":"data2"
    }
  ]
}

I want to pull the contents from the main ‘Data’ array from each file and make it look something like this:

{
  "Everything":[
    {
      "data":"data1"
    },
    {
      "data":"data2"
    },
    {
      "data":"data3"
    },
    {
      "data":"data4"
    }
  ]
}
Tags:

2

Answers


  1. 0

    You can use inputs in combination with the -n flag to address all input documents:

    jq -n '{Everything: [inputs.Data[]]}' *.json

    {
  "Everything": [
    {
      "data": "data1"
    },
    {
      "data": "data2"
    },
    {
      "data": "data3"
    },
    {
      "data": "data4"
    }
  ]
}

    Demo

    Login or Signup to reply.
  2. 0

    If you use the -s switch, there will be an implicit array wrapping around all objects emitted by the *.json, and so you can also do this without having to explicitly reference the inputs object:

    § jq -s '{ Everything:[ .[].Data[] ] }' *.json
{
  "Everything": [
    {
      "data": "data1"
    },
    {
      "data": "data2"
    },
    {
      "data": "data1"
    },
    {
      "data": "data2"
    }
  ]
}
    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search