As the person before said, "you cannot remove it completely". But try something like this:

:highlight VertSplit cterm=NONE ctermbg=NONE

This may get the result you expect.