Need to save CSV data set file as a "CSV UTF-8" rather than regular CSV. along with that Set "File encoding" field of "CSV Data Set Config" as UTF-8.
That's what worked perfectly for me.