I'm running a Spark application in AWS EMR. The code is like this: with SparkSession.builder.appName(f"Spark App").getOrCreate() as spark: dataframe = spark.read.format('jdbc').options( ... ).load() print("Log A") max_date_result = dataframe.agg(max_(date_format('date', 'yyyy-MM-dd')).alias('max_date')).collect()[0] print("Log B") This application always gets stuck for a long time…
I'm new to Ghost and I have just set up a ghost instance on AWS lightsail. I have followed the given guideline document and executed all steps successfully as per the doc https://lightsail.aws.amazon.com/ls/docs/en_us/articles/amazon-lightsail-quick-start-guide-ghost But when I finished setting up and…
I'm running Amazon Linux 2 AMI EC2 instance. On the instance, I'm able to install anaconda. After setting jupyter notebook config etc. I tried to open jupyter notebook on Chrome using the url https://ip-xxx-xx-x-xx.us-east-2.compute.internal:8888/ from nohup.out. The link never worked.…
I want to access config files from AWS AppConfig in .Net Core (AWS Lambda). How can I do that? I have seen in the AWS docs that the recommended way is to use the GetLatestConfiguration and StartConfigurationSession APIs but I…
I'd like to create a bash script using aws cli that start an ec2 image clone a github repo build a docker image stops the ec2 image. I managed to make the start and stop using aws ec2 start-instances and…
I have created a vpc, and created two subnets one is public subnet(attached to internet gateway) and another is private subnet. I am able to access private subnet from public subnet. My question is how the traffic goes out from…
How to create a Network Load Balancer with one or more Elastic IP addresses in front of the Application Load Balancer using AWS CDK? This should allow having fixed IP addresses for the load balancer. The article I need a…
I was trying to import an existing Security Group in CDK by using SecurityGroup.fromSecurityGroupId method and it failed with the following error: Security Group Id: sg-12345 not found! (Service: AmazonEC2; Status Code: 400; Error Code: InvalidGroup.NotFound; Request ID: 8e2cd924-075d-4c64-b5ba-2e1d9c72fe95; Proxy:…
Is there a way in CDK with Typescript to add items to a Dynamodb Table? I know how to create the partition/sort keys, but can't find any clear cut answer on just adding items or attributes to those items? Also…
I instantiate a boto3 S3 resource like this (code simplified): import os from pathlib import Path import boto3 s3_resource = boto3.resource( "s3", aws_access_key_id=os.getenv("AWS_ACCESS_KEY_ID"), aws_secret_access_key=os.getenv("AWS_SECRET_ACCESS_KEY"), # NOTE: My config is: # [default] # region = eu-west-1 region_name=os.getenv("region_name"), ) How can I…