The FindZLIB.cmake don't even include the static version library on Windows (source) and I created my PR for it.

It works in Linux since it annotates ".a" for static libs and ".so" for dynamic libs, but in Windows it's plain ".a"/".dll.a" (same for MinGW) or ".lib" (MSVC).