I found out the issue; When the velocity is negative, I wasn't flipping it yet was accounting for it as if it was negative;