Restarting slapd did not help clearing out the accesslog files for me. However, forcing the database to execute the DB_LOG_AUTOREMOVE helped:

On your system, run this command:

db_archive -d -h /var/lib/ldap/accesslog

It will force execute the set_flags DB_LOG_AUTOREMOVE and and purge the accesslog.