If I have KBs of data every few seconds, is using Kinesis Firehose with a Lambda function to perform a transformation and using Redshift as the target necessarily better than just doing the same except with S3 instead of Kinesis?…
I'm trying to get a local env to run/debug Python Lambdas with VSCode (windows). I'm using a provided HelloWorld example to get the hang of this but I'm not being able to invoke. Steps used to setup SAM and invoke…
I have an AWS API Gateway (HTTP) with the following routes: https://<API_HOST>/prod/account/list https://<API_HOST>/prod/account/edit https://<API_HOST>/prod/account/delete Based on each routing, I want different AWS Lambda functions to execute. What's the most optimized way to route the traffic at the AWS Lambda function?…
I'm trying to run a Glue job by calling it from lambda function. The glue job in itself is running perfectly fine but when I trigger it from lambda function, I get the below error: [ERROR] ParamValidationError: Parameter validation failed:…
I am new to AWS and having some difficulty tracking down and resolving some latency we are seeing on our API. Looking for some help diagnosing and resolving the issue. Here is what we are seeing: If an endpoint hasn't…
TechStack: salesforce data ->Aws Appflow->s3 ->databricks job Hello! I have an appflow flow that is grabbing salesforce data and uploading it to s3 in a folder with multiple parquet files. I have an lambda that is listening to the prefix…
I am trying to deploy lambda function with Serverless framework I've added my ADMIN credentials in the aws cli and I am getting this error message every time I try to deploy Warning: Not authorized to perform: lambda:GetFunction for at…
I am using AWS Dynamodb database that contains over 10M users, we had a mistake when processing some events and we did persist some records the wrong way. I created a script that scan the table by batch of 250…
I use pycharm to develop my lambdas locally. It turns out that by default the IDE doesn't recognize the handler function to start, so I have to comment out the code whenever I test locally. And when it goes up…
I got a lambda written in Go running on a container, the image was built with alpine-golang and run with alpine. When testing i noticed from the logs the lambda is ran twice before exiting with the following: Error: Runtime…