Have you tried to lower the value of C in svm = OneVsRestClassifier(SVC(kernel='linear', C=1e5))? Maybe you are overfitting to your data because of this (rather high?) value.
C
svm = OneVsRestClassifier(SVC(kernel='linear', C=1e5))