VS Code was recently updated to render SVG files as previews by default.

Paste this in your settings.json to disable the feature:

"workbench.editorAssociations": {
    "*.svg": "default"
}