the problem solved in spark 4.0.1 with:
spark.eventLog.enabled=true spark.eventLog.dir=file:///opt/data/metadata spark.history.fs.logDirectory=file:///opt/data/history