close_old_connections() doesn't work, because for async all the objects will live in different thread. And probably I was calling it differently, when connect in sync_to_async wasn't working. So in the end this works:

await sync_to_async(reconnect)()

with this function:

def reconnect():
    conn=connections['default']
    conn.connect()