Aws Lambda Deployment Package In Python Limites

I want to run my code on AWS lambda function. To do so, i need to import some python packages (i.e. pandas, numpy, sklearn, scipy) I have two problems: First of all, the size of (u

Solution 1:

You appear to have two issues.

The first (and easiest to solve) is that you need to install the relevant modules on a Linux distro comparable to Amazon Linux.

You can either do this using EC2 or in a Docker container with Amazon Linux on it.

The second issue (which is a bit trickier if not impossible to solve given the size of the modules you want to use) is that you need to get your deployment size down to under 250MB unzipped and under 50MB zipped.

Using relevant CFLAG when installing may get you some of the way there. See here for an idea of what might work.

If you are still over limit (which I suspect you will be) your only choice left will be to delete some of the files in the modules which you believe will not be used in your particular program. This is risky, often error prone and usually takes many attempts to get right. Using code coverage tools may help you here, as they can indicate which files are actually being used.