r/WebScrapingLab

▲ 3 r/WebScrapingLab+1 crossposts

What tools are currently in your web scraping stack?

I’ve been seeing a lot more Playwright lately, but still plenty of people sticking with Requests/BS4 or Scrapy when the site doesn’t need a browser.

I’m mostly using Python with Requests and BS4 for simple stuff, then Playwright when a site forces it.

Always interesting to see what people actually use once the scraper has to run more than once.

reddit.com
u/BlueLagoon226 — 1 day ago