A bit late for the OP but to help newcomers like me, the solution is to open allinone.sln, set for the Release/x64 build and select "Build full database file for solution" from the Build menu. For ICU 76, that built icudt76.dll with a size of about 32 MB containing 869 converters.