I have 1 million records in AWS dynamodb which I want to process everyday, basically Read the 1 million records. Apply some business logic on those records. Finally generate the request file with the million records and write on to…
Assume that I'm working in a hybrid cloud setup where some services run in and use AWS, and some not. For an API not running in AWS (i.e., not in EC2, not in Lambda, not behind AWS API Gateway), I…
I would like to get some sort of ordinal number for each instance in an auto-scaling group. Let's say that group have 5 instances maximum. I would like to have a number 0, 1, 2, 3, 4 or 1, 2,…
Recently I tried to deploy an resource "aws_s3_bucket_acl" resource using terraform, and received the error: Error: error creating S3 bucket ACL for bucket-name: AccessControlListNotSupported: The bucket does not allow ACLs │ status code: 400 I didn't see why this wouldn't…
I have been struggling with an issue in my Apache Airflow DAG for some time now. I am trying to use the snowflake-connector-python module in my DAG, and it is included in my requirements.txt file. However, when I try to…
I built this docker image that I would run like this. docker run -e AWS_ACCESS_KEY_ID=<my-access-key> -e AWS_SECRET_ACCESS_KEY=<my-secret-access-key> -it --rm -p 9000:8080 etl_pipeline:latest I'm mostly looking at the -e parameters. So when running this image locally it all works fine. But…
I am trying to convert my existing DynamoDB table to a global DynamoDB table. In the existing DynamoDB table structure, we have configured a DynamoDB Stream that triggers a Lambda function when there is a change in DynamoDB data. What…
We've got some Windows EC2 Instances deployed using Cloudformation that are configured using cfn-init scripts. In order to update components on the instances later on, we need to re-run some of the Cloudformation::Init configsets using the cfn-init helper scripts and…
So I am trying to host a full stack web application in AWS. I have a angular frontend sitting in an s3 bucket behind cloudfront and using a domain from route53. On the backend I have an typescript express project…
I am trying to allow access to a number of ipv4 ip addresses starting with 111.222 via a policy in aws s3, I have tried all the following but unable to get it to work - { "Version": "2012-10-17", "Id":…