Here's one approach I found useful. A web scraping browser can really simplify the process, especially when dealing with sites that have complex structures. I’ve tried a few tools, and this one seems to work well for bypassing restrictions and handling multiple sessions. You can check out more details
here, they have useful information on how it works