I have been recently challenged with an architectural problem. Basically, I developed a Node.js application that fetches three zip files from Census.gov (13 MB, 1.2 MB and 6.7 GB) which takes about 15 to 20 minutes. After the files are…
I have an architecture similar to https://github.com/aws-samples/ecs-refarch-cloudformation I would like to know if I can have an AutoScalingGroup with instances in private subnets without using NAT Gateway? I was experimenting with removing the NATs and adding VPC endpoints but I…
I'm trying to implement a dead letter queue for failed lambda events. I created an SQS queue and two lambdas. One lambda only throws an error and the other listens to the SQS queue and is triggered when the queue…
I mistakenly deleted codedeploy-agent folder now I cannot run install or codedeploy erase, Stop codedeploy-agent in preun hook if this is an erase. Stopping codedeploy-agent:/etc/init.d/codedeploy-agent: line 45: cd: /opt/codedeploy-agent/: No such file or directory Unable to stop the running codedeploy-agent…
I'm trying to migrate a Redshift SQL script to Snowflake and trying to emulate week number on Snowflake. Below is the sample Redshift code: select cast(to_char('2020-01-06'::date, 'WW') as int) as week, cast(to_char('2020-01-06'::date, 'IW') as int) as iso_week, '2020-01-06'::date; The closest…
I have a lambda function in Account A which will retrieve data from a source. This lambda will then need to trigger off a lambda in Account B in order to pass this data to it which then will be…
I have a Terraform GitLab runner I've provisioned in my kubernetes cluster via Helm to execute Terraform related CICD pipelines. The runner users a specific service account that has access to a provisioned IAM Role for the runner using IAM…
I am using DynamoDB. I have a table which has GSI (Global Secondary Index). GSI partitionKey values are unique. I want to use query operation to get items using GSI partitionKey. Usually when you use query operation you need to…
I would like to store a terraform state file in one aws account and deploy infrastructure into another. Is it possible to provide different set of credentials for backend and aws provider using environmental variables(AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY)? Or maybe provide credentials…
I'm trying to get my terraform for perform a for_each argument, but getting the below error; The given "for_each" argument value is unsuitable: the "for_each" argument must be a map, or set of strings, and you have provided a value…