The Server must be configured to trust the Client certificate as well. Have you set that up?
Another possibility is that the Server is using a CA signed certificate instead of a self-signed, in which case you must ensure the CA certificate is trusted on your side.