You can push container images to Lambda: docs.aws.amazon.com/lambda/lates...
For the first year you get 500mb for free in the elastic container registry. If you don’t mind moving over to Google Cloud - CloudRun will do what you want mostly free. I think CloudBuild is cheap.