I also tried to find something like that in VS Code, but I didn't find any extension like this. Finally, I have created an extension for this. You can try this extension
"Extra Cursor Caret Height"