In the comments under the answer from Zeroshade, li.davidm gave an insight to a solution that works, in that a normal pip installation of the packages will not work. Instead, you need to use a conda environment to have this sort of system work. At the time of writing this, the latest drivers work just fine.