I think this could be solved with SeleniumBase, but for me the main problem isn’t the code itself, it’s that the link doesn’t change when you apply filters. The site uses onclick to load results dynamically, so every time I leave the store page, the filter resets and I have to start the filtering process all over again.

On a site like Maroof, that’s really frustrating because it’s extremely slow to filter, each time feels like waiting forever.

Not to mention that it is so hard to apply the filters itself

Maybe it’s just me not having enough experience yet, because I’ve only been learning web scraping for about a month. But from what I’ve seen, without direct links or a persistent filter state, you either have to cache the results in one session or find the underlying request/API the site uses to fetch the data and call that directly.