Our book has a chapter on early stopping / internal tuning https://mlr3book.mlr-org.com/chapters/chapter15/predsets_valid_inttune.html