At some point the documentation was updated to confirm this:

• Result backend is updated before on_success/on_failure - other clients can see the task as finished while handlers are still running

So yes, another worker can start working on the next task before the on_success of the previous task has finished.