SFCC – Help exporting all Products from Salesforce Commerce Cloud (Demandware) to XML or CSV – Shopify

I export all products daily to SQL Server through a C# job. The important parts of the code are below.

Using OCAPI Data ProductSearch, you would first create a request to see how many total products you have. You can only get 200 products at a time so you have to calculate the total number of times to call the api.

var countQuery = "{ "query": { "term_query": { "fields": ["id"], "operator": "is_not_null" }}}";
var countContent = new StringContent(countQuery, Encoding.UTF8, "application/json");
var urlUri = new Uri(url);
var countResponse = await client.PostAsync(urlUri, countContent);
string countResponseString = await countResponse.Content.ReadAsStringAsync();

dynamic countJson = JsonConvert.DeserializeObject(countResponseString);
int records = countJson["total"];
// determine number of times to call api, rounding up.
int calls = (records + (200 - 1)) / 200;

Pull the products 200 at a time in a loop. We use this to compare the list of New and Removed products every day. It is also good to compare products with price changes. Or just to export for other uses.

for (var i = 0; i < calls; i++)
{

    var query = "{ "query": { "term_query": { "fields": ["id"], "operator": "is_not_null" } },"select":"(**)","expand":["all"], "start": " + i * 200 + ", "count": 200 }";
    var content = new StringContent(query, Encoding.UTF8, "application/json");
    var response = await client.PostAsync(urlUri, content);
    string responseString = await response.Content.ReadAsStringAsync();

    dynamic json = JsonConvert.DeserializeObject(responseString);

    Console.WriteLine("DW products status: " + i * 200 + " records.");

    foreach (var obj in json.hits)
    {
      // Do stuff (create csv, write to db, etc)
    }
}