Ultimately what I was looking for was Assembly Definitions, which does divide a Unity project up into separate projects (.csproj files) in Visual Studio (and other IDEs like Rider).

However, it doesn't speed up build times, but it does speed up compilation time when making code changes: only the assembly that contain the code change or the assemblies that depend on the changed assembly recompile, instead of the entire project.