I can't comment @chwarr's thread because I'm lower than 50 reputation, so I just post here. Sorry for the inconvenience.

I found that an undocumented option called /linkermember was used by /all option. It provides the function of show members in library files.

TL;DR

Inspired by @chwarr, I reverse analyzed dumpbin.exe and link.exe. dumpbin.exe just simply invokes link.exe with additional /DUMPoption and all of its options. I found that the entry point function of COFF dumper named DumperMain(int,ushort * * const) and the command line parser function named ProcessDumperSwitches(void) in link.exe. After a few attempts, I found the above I mentioned option.