# What technology are your crawlers built with?



##### Post Metadata
- Posted at: over 6 years ago
- Net upvotes: 1


## Comments
### Comment 1

All our crawlers are built using Scrapy, the open source web scraping framework our founders created. Additionally, we use numerous other open source frameworks which we’ve developed that ensure your not locked into using propieratry technology. We use Crawlera as our proxy solution and Splash as a headless browser if one is required.

##### Comment Metadata
- Posted at: over 6 years ago
- Author title: Marketing Executive at Scrapinghub




## Related Product
[Zyte](https://www.g2.com/products/zyte/reviews)

## Related Category
[Web Data Providers](https://www.g2.com/categories/web-data-providers)

## Related discussions
- [How well does Trello scale into a larger team?](https://www.g2.com/discussions/1-how-well-does-trello-scale-into-a-larger-team)
  - Posted at: about 13 years ago
  - Comments: 6
- [Can we please add a new section](https://www.g2.com/discussions/2-can-we-please-add-a-new-section)
  - Posted at: about 13 years ago
  - Comments: 0
- [Quantifiable benefits from implementing your CRM](https://www.g2.com/discussions/quantifiable-benefits-from-implementing-your-crm)
  - Posted at: about 13 years ago
  - Comments: 4