for anyone still encountering this issue, inserting the debug urls at the top of the list works

if settings.DEBUG:
    import debug_toolbar
    urlpatterns.insert(0,path(r'__debug__/', include(debug_toolbar.urls)),)