I've created the pipeline again from scratch and it is now working with the lookup and foreach.

The initial pipeline was a copy of an existing one with the datasets changed. I've had issues before when I've copied existing pipelines but I've never seen this error before.

In future I'll just create all pipelines from scratch I think.

Thanks everyone for your help.