Thank you everyone for your input. In the end it was a mix of answers that was correct.
I moved the timer into .onReceive so it also gets killed when not in use anymore. And I just give the Array now and access each element as a number, so it is not necessary anymore to give elements to the views.
Thank you so much for helping me even with this beginner question. My understanding of SwiftUI is growing with each problem.