Found a solution, not optimal but is best solution. It works with daylight savings also:

bar_data['time'] = (bar_data['time'].dt.tz_localize('UTC').dt.tz_convert('EST').dt.strftime("%Y-%m-%d %H:%M:%S"))

This converts the date time object into a string without the timezone and this will chart properly through lightweight_charts api.