I am hosting a serverless docker app in AWS Lambda this is a .net 8 (however 6 and 7 and even beanstalk behaved the same). The app is .net lucene (4.8 which is in beta) search (index is quite small 140MB and is bundled with the app – this runs perfectly fine locally (in docker) and in Azure Functions app – in 2 digits ms response time. However once this is deployed in AWS this could be in mid 3digits ms response times.
I’m quite new to docker – what could I try to get down to 2digit ms response time in AWS
2
Answers
Suggestion by @stdunbar was indeed helpful. Once I mounted an EFS volume to the container the performance returned to what I was expecting.
If your dependencies support it, consider publishing your App using AOT. This removes the need for your code to get JITed each time, which can improve responsiveness especially on the frequent cold starts when you scale to 0.
If full AOT isn’t on option, consider Ready To Run which can reduce the need to JIT your code on initialization (but allows for tiered compilation to use JIT later if desired)