It turns out I had to try both possible solutions:
Increase HTTPC_TASK_STACK_SIZE even further to 8*1024
Downgrade the ESP32 board library to version 2.0.17
Although I declare this issue as solved, I'm not really satisfied with the solution, because I'd rather use the latest ESP32 library.