As @jqurious pointed out in the comments, this is easily solved with...
df_resampled.explode(pl.exclude("colA"))