Cloudflare detection bypass
I'm trying to bypass Cloudflare Bot Protection when scraping sites via Python
Tried methods such as requests through the curl cffi and tlsclient libraries instead of the standard requests, but to no avail. Various PlayWright/Selenium forks did not work.
The only working solution is Undetected ChromeDriver. The problem with this method is speed and weight. Selenium-based parsing is slow to playwright based. I was able to solve this problem. But the most important thing remained - the size of the project. Undetected Chromedriver and other drivers require a browser, which is already a huge size of 100 megabytes. Does anyone have any suggestions for solving this problem? Or i should completely forget about scraping attempts without browser emulation