go to settings of extension then "Folder: Theme" it must be showing "specific" which is a by default setting but instead change it to "classic" your icons will start showing up. now you could change it back to specific setting if you want, the icons will remain same. just solved this issue on my vsc thought of answering this question.

PS - posting it now for the future audience. :)