Check this video by Andrej Karpathy: video here

He has explained much of the autograd engine in as simple language as possible

He breaks down the computation graph and autograd concepts in the a miniature version called "micrograd", making it super easy to grasp how it all works under the hood. Trust me, after watching this, you’ll have a solid understanding of everything!"