As @F.Hauri and @Cyrus suggested, you would need an another command running. Since, I am using a Python CLI, the title doesn't go away until it returns to it's shell.
In Python, you would do:
os.system("echo -en '\033]0;My new title\007'")
Thank you @F.Hauri and @Cyrus for answering this!