I was finally able to deploy the app...but I am not sure if that's the right way to do it... but just so you know, this works.
I created an instance of the MLFlow container. Then I got the Public IP generated from that.
I went back to my local code and I added that URL from the MLFlow container running on Azure to the streamlit code as the "Tracking URI".
Then I created another docker container and redeployed it as version 2.
On Azure, I have created a new instance of the v2 streamlit app.
It worked.
It is not an HTTPS, though...no clue how to make that become a secure URL... well, keep learning.
Cheers.