I figured this out using JObject to a JArray and then converting back to an JOBject when iterating through each item of the array so I can access the remove property for that particular property. Solution is here:
https://dotnetfiddle.net/TDJ87v