I have newly started working in spark-scala. I have a requirement where in I need to find the sum for few columns within a case statement. I've written the corresponding spark-sql code but unable to implement the same in spark-scala…
I am having trouble getting estimateTransport() to work It is returning FTXGatewayService.estimateLtlShipment returned error code: 412 Why? The ShipmentType of Small Parcel / "SP" works, but "LTL" does not. The Amazon workflow says to first PUT to fba/inbound/v0/shipments/FBAxxxx/transport Then POST…
I have some configuration data i want to read from the spring boot application. The configuration can get bigger and bigger, therefore i dont want to create yaml file in the project. I was thinking about what would be the…
I'm migrating our ML notebooks from Azure Databricks to AWS environment using Sagemaker and Step functions. I have separate notebooks for data processing, feature engineering and ML algorithms which I want to run in a sequence after completion of previous…
I am using the AWS SDK for PHP to push a message into an AWS SQS queue. I'd like to be able to set the visibility timeout for specific messages to be different than the default. It would make sense…
I have an SNS topic and an HTTP subscription, that call a Spring boot endpoint, my endpoint looks like this: @RestController public class MyController { @PostMapping(value = "/path") public ResponseEntity<Void> action(@RequestBody Object body) { return ResponseEntity.noContent().build(); } } I try…
What APIs are available for tasks running under ECS fargate service to get their own memory and CPU usage? My use case is for load shedding / adjusting: task is an executor which retrieves work items from a queue and…
I want to read a JSON file in PySpark, but the JSON file is in this format (without comma and square brackets): {"id": 1, "name": "jhon"} {"id": 2, "name": "bryan"} {"id": 3, "name": "jane"} Is there an easy way to…
I've got a terraform plan that creates a number of resources in a for_each loop, and I need another resource to depend_on those first ones. How can I do it without having to explicitly list them? Here's the first resource…
For instance Try one failed, Can we pass few parameters to to event object of the next retry by something like below? event.somevariable = somevalue If we want do something like that what could be our options?