I am trying to set up a CI/CD for my GitHub repo using CodePipeline. I have set up all stages: In the Source stage, the action provider is GitHub. It links my repository. The entire code pipeline is able to…
When I try to upload files to S3 from storage via an application deployed on the stand with a file size of 1mb and above, I get an error com.amazonaws.SdkClientException exception: The HTTP request cannot be executed: The peer resets…
I am trying to connect to my aws s3 client using roleArn instead of static secretKey and accessKey for the roleArn i created Trust relationships: { "Version": "2012-10-17", "Statement": [ { "Sid": "", "Effect": "Allow", "Principal": { "Service": "s3.amazonaws.com" },…
Does anyone have an idea on how to integrate AWS Bedrock and AWS Knowledgebase on code. I have already synced my Bedrock and AWS Knowledgebase. i am trying to make sure that the code works. and it would help alot…
I'm creating a download link to an item that is stored on AWS / S3. As I am building out this link, I've confirmed that the data is encoded in UTF-8, but when the user goes to download it, they…
I am using EMR 7.0.0 version, which has python 3.9, spark 3.5.0, Hadoop 3.3.6 in AWS. I got the error: File "/usr/local/lib/python3.9/site-packages/pyspark/python/lib/pyspark.zip/pyspark/sql/readwriter.py", line 740, in csv File "/usr/local/lib/python3.9/site-packages/pyspark/python/lib/py4j-0.10.9.7-src.zip/py4j/java_gateway.py", line 1322, in __call__ File "/usr/local/lib/python3.9/site-packages/pyspark/python/lib/pyspark.zip/pyspark/errors/exceptions/captured.py", line 179, in deco File "/usr/local/lib/python3.9/site-packages/pyspark/python/lib/py4j-0.10.9.7-src.zip/py4j/protocol.py",…
I have multiple files uploaded in S3 bucket and I want to print the names of the files in the output in a list through lamda python . Lets say I have files S1,S2,S3 ... and so on and I…
I'm working on a Spring Boot backend service where I need to access certain S3 buckets programmatically using IAM Roles Anywhere. I found the following documentation for RolesAnywhereClient in the AWS SDK for Java V2: https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/services/rolesanywhere/RolesAnywhereClient.html However, I’m unsure how…
I am trying to use ytdl-core in an AWS lambda function to upload an .mp4 of a youtube video to an S3 bucket. However, I cannot get ytdl to create a stream with any data in it, so nothing is…
I have a s3 bucket "bucket1" inside which I have a directory named "dir1". Inside this directory there are multiple files. I just want to create a list of all the file names in this directory in my pyspark code…