As mentioned by @ben-manes cleanUp() needs to be called prior factors.asMap().keys
cleanUp()
factors.asMap().keys