Solution with O(1) time complexity, just check is it possible to get first item of iterator:
first_item = next(iter(iterator), None)
if first_item is None:
print(f'Iterator is empty')
if first_item is not None:
print(f'Iterator is NOT empty')