I found the answer.

I didn't know I needed to make the change to the hosts file on my co-workers computers (not just the computer with XAMPP). I also didn't know I needed to install the certificate onto their computers as well (not just the computer with XAMPP). Once I did both of those things. my co-workers were able to access site.local with https instead of the IP address and http.