I believe the correct format will be:

import json

fs = fsspec.filesystem(protocol='gs', token=json.loads(service_account_json_key)

csv_files = fs.listdir("bucket-name/path-to-file")