Why do you think it should?
Documentation says that SemaphoreSlim: Blocks the current thread until it can enter the SemaphoreSlim.
Release method docs are not very clear but I would just expect that your big number should just release current and other threads. See remarks section.