I finally solved the problem like this:
This way loading "one big set of values" doesn't block the UI thread for multiple seconds; the UI remains useable.
Care has to be taken when setting the currently selected item - this has to be postboned until the loading thread is finished.
I would have preferred to use a concept like SWT.Virtual. Unfortunately the API isn't perfectly consistent between controls.