I ran into this exact issue with webscraper.io — the "next button" pagination is a pain when you have hundreds of pages.

I ended up switching to BrowserAct because it handles this automatically with natural language prompts. You basically tell it "loop through all pages by clicking next" and it does it without needing to manually map each page.

Here's a working example using their Reddit Scraper template — it automatically loops through Reddit posts (which use infinite scroll/next button navigation) and extracts all the data. Same logic works for any pagination.