If anyone is looking for a quick solution give this a go - zipkit.io

Before I built this I tried it all, stream, lambda, background workers but each solution for one reason or another didn't scale.