The solution for me was to use https://github.com/BtbN/FFmpeg-Builds with variant gpl-shared, and use that as the layer instead of john van sickle's pure static ffmpeg.