I guess I vaguely figured out my issue, it can be reflections because of the wrong terminating resistor values being 60 ohms instead of the 120 ohms. But I need to see how I can fix that.