I always thought it was because all these comments have been cancelled for some reason by YouTube itself. Could it be?

I noted the same issue. The point is that the amount of "missing" comments deeply changes from topic to topic. For instance controversial topics such as "immigration" has an average deletion rate of 70%, while less controversial topics, such as technology or archeology have an average deletion rate of 30%.