try using an amazon linux compatible prebuilt wheel

you can using this container as it has same env as lambda

docker run -it --rm amazonlinux:2

in docker container install requirements make sure to use venv

yum install -y gcc gcc-c++ python3 python3-devel