The /public folder is meant to store static files (JavaScript, CSS, images etc), so using it to serve dynamically uploaded files isn't a great solution.
You'd need to store the files on an external service, e.g. AWS S3. Then you can store the URL to access it in your DB, and fetch the file from S3 with that URL whenever a user requests it.