It looks like the spl package is separate from solana, so you should just be able to do from spl.token import instructions.

I looked at how it was used in tests at https://github.com/michaelhly/solana-py/blob/669055a8945739f04d131310b2e78bc619fce54d/tests/integration/test_token_client.py#L7