So I found out the issue. You cannot manually apply which Dolly to track for whatever reason. You have to do it through script and tell it that the tracked dolly is your camera.