Looks like .rsample() is doing the trick here, which is keeping the computational graph alive...
.rsample()