For Windows, below command run in command prompt (doesn't work in PowerShell) at the respective folder gives the row count:
find "," /c yourfilename
Reference: https://www.reddit.com/r/excel/comments/l7gue6/way_to_show_number_of_rows_in_csv_without_opening/