I was able to solve my problem through this post: Container creation error in Github codespace using a repo forked from microsoft learn

I just added "-bullseye" to .devcontainer/Dockerfile.

and updating the Agent URL to https://download.agent.dev.azure.com as what suggested by user31188334