If you're looking for the cheapest setup with minimal traffic, here's a combination you can try:
AWS Lambda to run your API backend.
Amazon S3 + CloudFront to serve static content (HTML/CSS/JS).
Amazon Aurora Serverless (MySQL or PostgreSQL) or RDS (MySQL/PostgreSQL) for the database.
This would significantly reduce costs as you only pay for usage, and all infrastructure management is handled by AWS. Total costs could be around $10-30/month depending on your exact usage.
Or like you mentioned, GoDaddy would be a simpler/cheaper route, but may cost you the flexibility.
If this solution works for you, please consider marking the answer as accepted to help others who might have a similar question. Thanks!