After installing the appropriate PyTorch I ran !pip install -U bitsandbytes (to install updated version). It requires restart the session to see the updates. So I restarted the session and installed all remaining packages again! Bingo! it worked (https://huggingface.co/google/gemma-2b/discussions/29)