I lambda function that returns a bunch of requests that I want to send to an external service. This external service has an api with the following rate limit: Paramters: type: enum content: list of n elements Rate limit: For…
I receive from provider APIs multiple json item update at once and do not control how much can be received in the sense that sometimes there can be 1 item and sometimes 100k items. these items are put in a…
I'm using an LambdaToSqsToLambda pattern Now, the second Lambda (the one that polls messages from SQS), can fail, and I'm using the BatchItemFailures to report the messages that failed to SQS, and letting SQS re-insert those messages back in the…
I have the following Cloudformation template that deploys a HTTP API gateway with a custom Lambda authorizer that delivers to an SQS queue. I process the messages in the queue with another lambda that is not shown here. When I…
I'm currently working on a project where I've set up AWS Lambda functions using the Serverless Framework to process jobs from an SQS queue and create entries in a DynamoDB table. The deployment seems to be successful, and there are…
I want to invoke lambda multiple times but not concurrent with invocation having 30mins(some minutes) having event custom information & buffer in between 2 lambda triggers. So basically, 1 lambda invocations at a time. My Expectations: Any AWS service to…
I recently implemented DLQ(Dead Letter Queue) for SQS. I have done the following three configurations. Default visibility timeout in SQS. In the Dead Letter Queue configuration, enable and Maximum receives are configured as 3. In Lambda configuration, Report batch item…
I need to create a job that is going to be trigger after 15 minutes a post is created, I can set 15 minutes of delay, but imagine that the job is going to take 1 minute to process, in…
I am trying to implement serialization in the consumers of a SQS queue, which runs in multiple nodeJs instances. i.e. what I am trying to do is ensure that stuff is done in the same order they came in, one…
I have created a python script which processes videos using Selenium on an EC2 instance, taking input from an SQS queue for each message. This works fine for a single video, but I need to process hundreds of videos concurrently.…