I had a similar problem. The excel file had NaN as text but the style was double. When load in excel it showed a datetime field with custom format.

The solution was to simply save the file from excel without changing anything. After this all the NaN were gone.