ValueError: too many values to unpack (expected 4) Means that you need more variables to unpack env.step(): 1_new_obs, 2_reward, 3_termineted, 4_truncated, 5_info = env.step(random_action)