I have a step function which has 2 states, lets suppose state1 and state2, state1 triggers a lambda and returns a wait state to state1, step function waits. Lambda triggers aws batch, on completion of aws batch, it should resume…
I have some work that needs two s3 objects. Object A is uploaded by another system; I have to generate the Object B. In fact, there is not one Object A, but several (A1, A2, A3). Each one is uploaded…
Say I have a simple input: { "input_array": ["blue", "green", "orange"] } Which I am passing into a state machine with a couple of Map states: { "StartAt": "Step One", "States": { "Step One": { "Type": "Map", "ItemsPath": "$.input_array", "ResultPath":…
I am new to the AWS ecosystem and I am trying to design a POT that involves sending data from an AWS Kinesis Data Stream to an AWS Step Function. I know I can make a Lambda function to consume…
I'm creating a Step function workflow with multiple embedded workflows (using startExecution.sync:2). I noticed that all of the embedded workflows appear to have a 2-3 second overhead. This appears to be the same across all of my embedded workflows. Is…
Working in Node.js with AWS lambdas, I know: Lambda Context is passed to the handler as a second parameter Step Function Context can be obtained at various points in the data flow, the most useful being the Parameters step, where…
https://www.jnto.go.jp/jpn/statistics/since2003_visitor_arrivals.xlsx I have the above public website. The website or file is updated once a month by the admin of that website. Can you please tell me how to trigger State machine when that above website is updated? I have…
I have step function with 5 steps, each step writes to s3 I want all steps to write to s3://my-bucket/my-step-function/YYYY/MM/DD/HH/mm/specifc-step-name/ and that date of the dir will be the same in all steps Is there a way to calculate the…
I have an S3 bucket which holds a pipeline.log file. Each time I run a lambda function, I want the logs to be written and then uploaded to my S3 bucket. I have created custom functions that handle the downloads…
We could ingest 2 datasets (dataset A and dataset B) daily, dataset A may or may not show up everyday. They both trigger separate Step Functions. step function B with dataset B cant run until step function A with dataset…