What do you dislike about Scrapfly?
Reliability isn't quite 100%, and the failures are quiet. Every so often a request comes back with a 200 but the payload isn't the actual target page — an interstitial or a partial render. Nothing in the response makes that obvious, so my code initially treated those as "no data" and silently skipped listings. I had to add a retry loop (up to three attempts, then give up) before the results were dependable. A clearer signal that a returned page isn't a genuine target render would save everyone that guesswork.
I also had one call hang far longer than I expected instead of failing fast. Setting an explicit connect/read timeout on my side fixed it, but a documented or enforced upper bound would be better than each user discovering it the hard way.
On planning: it's hard to size a plan up front, because an ASP + JS-rendered call consumes noticeably more credits than a plain fetch. The free tier is gone after a few dozen of those, which is a short runway for a real evaluation. A simple "credits per call for this configuration" estimator would make choosing a tier much easier. Review collected by and hosted on G2.com.
Recommendations to others considering Scrapfly:
To improve reliability, consider implementing a more robust error detection mechanism that can identify when a returned page is not the intended target. Additionally, providing a documented timeout limit for requests could prevent unexpected delays.
For better planning, offering a clear estimator for credits consumed per call based on configuration would help users choose the appropriate plan more effectively. Review collected by and hosted on G2.com.
What problems is Scrapfly solving and how is that benefiting you?
Before, my pricing on the marketplace I sell on was effectively blind. To know what competitors charged I would have had to open each product page by hand, so in practice I didn't — prices sat untouched for weeks. I couldn't tell which listings were losing the buy box, and I had no way to automate it: my server simply couldn't read those pages because of the anti-bot protection.
Scrapfly solved exactly that one blocking piece. Now a job runs every three hours, fetches the full offer list for each active listing — every seller with their item price and shipping cost — and repositions my price automatically: undercut the cheapest competitor by one cent, match the sellers I don't want to undercut, never go below the floor I set per product.
Two concrete results. First, it surfaced listings priced far under the market: one sat at €19.99 while the cheapest competitor's total was €28.53, so I could raise it and still be the cheapest offer. Second, it caught the reverse — listings I'd silently lost the buy box on, like one at €149.99 against a competitor at €129.99.
The shipping detail matters more than I expected: a rival with a lower item price but paid shipping is often the more expensive total offer. You only see that with the complete offer list. Time spent on price checks went from "would take an hour per round" to zero, and the margin recovered on a single listing covered the monthly plan several times over. Review collected by and hosted on G2.com.