Seems that from webpack 4 to webpack 5, in order to get the DLLPlugin to work the same, entryOnly needs to be set to false. This seems to have fixed the issue for me.
DLLPlugin
entryOnly