I’m solo on a very small budget. In situations where I need to spread load across multiple different IP addresses, I use my two VPNs, which gives me 10 IP addresses in total and costs about $10 a month. For webscraping purposes, this connections are overkill in terms of bandwidth. I don’t need 40 mbit connections, but I would like more IP addresses.
Is there some solution out there that’s a bit more tailored to webscraping, and perhaps offers many more IP addresses at expense of bandwidth, or potentially even latency, for just a few $/£ a month?
As long as the requests rate keeps in certain bounds tor is a very good option
Infinite requests, “infinite” IP adresses, and since tor is used by some ddos attacks, it should be sufficient for ur use. But make sure to be nice and not spam requests
I’ve tried at least a dozen paid ones. My needs require residential rotating proxies. I have a GSA proxy scraper and I can scrape excellent non-res proxies is there any script anyone knows of that will allow the scraping of res? I understand it is doubtful but I would like to be self sufficient!
Thank you for contributing to r/webscraping! Referencing paid products or services is generally discouraged, as such your post has been removed. Please take a moment to review the self-promotion guide. You may also wish to re-submit your post to the monthly self-promotion thread.
Wait. When I was using it was 1000 free requests per 30 days. As I was just doing a hobby project I didn’t want to pay for proxy servers so I searched many many apis like these and scraperapi was by far the best for me.
scarperbee.com was 2nd best. I alternated between these 2.