It looks like "pydantic_core" is platform-specific. So, if you are building/packaging on macos and running on AWS arm64 for example, that will not work.
Try building/packaging lambda in the container and choose the build image that matches Lambda environonment.