AWS Presigned URL valid for more than 7 days – Amazon web services
Just wanted to know is there a way to use AWS S3 Presigned URL for more than 7 Days using V4 of Presigned URL.
How can I retrieve private IP from a container on AWS ECS? – Amazon web services
I am trying to retrieve the private IP from my containers on AWS ECS, I am using python and boto3 for that work. That is my code: import json import boto3 def lambda_handler(event, context): client = boto3.client("ecs", region_name="sa-east-1") clusterArn='ANY ARN'…
How to specifify the class of an AWS client in Python? – Amazon web services
In Java, for instance, we have a class that represents the SageMaker client class: AmazonSageMakerClient, but I couldn't find the equivalent for Python. I was hoping to be able to do something like: from sagemaker import SageMakerClient client: SageMakerClient =…
Amazon web services – How to get the region of a boto3 S3 resource instance
I instantiate a boto3 S3 resource like this (code simplified): import os from pathlib import Path import boto3 s3_resource = boto3.resource( "s3", aws_access_key_id=os.getenv("AWS_ACCESS_KEY_ID"), aws_secret_access_key=os.getenv("AWS_SECRET_ACCESS_KEY"), # NOTE: My config is: # [default] # region = eu-west-1 region_name=os.getenv("region_name"), ) How can I…
Amazon web services – How to generate url for the s3 object without expiring?
I have uploaded an object with the client = boto3.client('s3', aws_access_key_id=AWS_ACCESS_KEY_ID, aws_secret_access_key=AWS_SECRET_ACCESS_KEY) response = client.put_object( Bucket=BUCKET_NAME, Body=in_mem_file.getvalue(), Key=str(img_name)) and I'm generating the URL by url = client.generate_presigned_url('get_object', Params={ 'Bucket': BUCKET_NAME, 'Key': str(img_name)}, ExpiresIn=518400) I need to generate the URL without…
Amazon web services – How to prevent AWS Glue crawler from reading wrong data types?
I am running AWS Glue crawler on a CSV file. This CSV file has a string column which has alpahanumeric values. The crawler is setting the data type for this columns as INT (instead of string). This is causing my…
Amazon web services – Not all folders returned by boto3 Bucket.objects.all()
My S3 bucket contains a bunch of files in a multilevel folder structure. I'm trying to identify the top level folders in the hierarchy, but objects.all() returns some but not all folders as distinct ObjectSummary objects. Why? Sample file structure:…
Amazon web services – Is it possible to list bucket using AWS Lambda based on tags?
Have a requirement like need to delete buckets that are 15 days old and having a tag like Type: Test. Is this achievable using an AWS Lambda function?
Amazon web services – Is it possible to create a S3 Bucket in us-east-1 using AWS Python Boto3
Documentation import logging import boto3 from botocore.exceptions import ClientError def create_bucket(bucket_name, region=None): try: if region is None: s3_client = boto3.client('s3') s3_client.create_bucket(Bucket=bucket_name) else: s3_client = boto3.client('s3', region_name=region) location = {'LocationConstraint': region} s3_client.create_bucket(Bucket=bucket_name, CreateBucketConfiguration=location) except ClientError as e: logging.error(e) return False return…
Amazon web services – AWS Error "Calling the invoke API action failed with this message: Rate Exceeded" when I use s3.get_paginator('list_objects_v2')
Some third party application is uploading around 10000 object to my bucket+prefix in a day. My requirement is to fetch all objects which were uploaded to my bucket+prefix in last 24 hours. There are so many files in my bucket+prefix.…