According to this paper I found, posted 2 years after the OP, states that a network backbone simply a pretrained neural network that is being 'repurposed' and integrated into a new network.

It's called the backbone because it bootstraps the entire entire model.

Very late, but hope this helps!