You write that it works with scan_csv. Looking at the documentation scan_csv seems to be the only option to support glob patterns.

read_csv: Read a CSV file into a DataFrame.

scan_csv: Lazily read from a CSV file or multiple files via glob patterns.