I have a notebook on Sagemaker notebook instance that runs some logic and updated files on S3 accordingly. I would like to automate that notebook to run at scheduled times. I copied the script to S3 and created a lambda…
I have an S3 bucket that contains multiple different files by date with different schemas (they are not in sub-folders). For example: FileTypeA-032323 FileTypeA-032423 FileTypeA-032523 FileTypeB-032323 FileTypeB-032423 FileTypeC-032323 FileTypeD-032423 FileTypeD-032423 FileTypeD-032523 I need to merge all of the files for…
I have a user table with following attributes: FirstName LastName City CompanyName I want to query the table with any combination of these attributes and that too partial . For example: Input - Firstname- "bh" and lastname - "ta" Output…
when testing my Lambda function. I always just get this error, this obviously does not help debugging: OpenBLAS WARNING - could not determine the L2 cache size on this system, assuming 256k START RequestId: a22379c9-427c-45ab-bfd5-c166bf507418 Version: $LATEST 2023-04-29T15:45:42.496Z a22379c9-427c-45ab-bfd5-c166bf507418 Task…
I need to have access to a 50 GB dataset I found in Kaggle[https://www.kaggle.com/]. The problem is that my computer memory and my internet connection are pretty bad, so I thought it would be a good idea to save that…
I am trying to create a custom visual transformation in a visual etl job in order to add a column to the output. The name of the column is something I would like to parameterize and pass at runtime using…
I'm trying use JavaScript, Lambda and SES to generate an email from a contact form. The code works when I test it from the Lambda console, but when I invoke it with HTTP it doesn't work, even though I have…
I want to upload the file to S3 from browser accessing the web application running on Fargate However, this S3 must have block public access=ON. So, It is impossible to upload directly from browser. Then, I have some alternative ideas,…
I built this docker image that I would run like this. docker run -e AWS_ACCESS_KEY_ID=<my-access-key> -e AWS_SECRET_ACCESS_KEY=<my-secret-access-key> -it --rm -p 9000:8080 etl_pipeline:latest I'm mostly looking at the -e parameters. So when running this image locally it all works fine. But…
I am trying to convert my existing DynamoDB table to a global DynamoDB table. In the existing DynamoDB table structure, we have configured a DynamoDB Stream that triggers a Lambda function when there is a change in DynamoDB data. What…