First, like I see others also said already, I don't think you should be keeping the token in the local storage.
I believe localStorage.removeItem should work, perhaps your name/path to the token ('accessToken') is incorrect.
I see it's a pretty old question, but hopefully that could help someone else. =)