Thanks to comments to my question, I found a solution that satisfied my requirements.

I ended up writing the following in the requirements.txt file:

--no-binary just_playback~=0.1.8
just_playback~=0.1.8

And installing it with pip like this:

pip install -r requirements.txt .