You should put a list of strings in the Junja2Templates class just as I did and it solved my issue.
templates = Jinja2Templates(directory=['html_templates', 'app/html_templates'])
Oficial starlette docs: https://www.starlette.io/templates/