Man i am facing the same issue for some reason every time you switch between playables in a single playable director it looses its reverences. but this is only happening in certain gameobjects as i still use a single playable director with multiple playables. but for some reason it doesn't work on other gameobjects. so some fix you can do is have multiple playable directors each dedicated for each playable.

If you found a better solution let me know.