When you put the participant on hold also mute them using the twilio rest api. Then unmute them when you take them off hold. This should prevent the conference music from being heard on the recording.

See twilio logs on how to mute: https://www.twilio.com/docs/voice/api/conference-participant-resource#update-a-participant-resource