At Scrapinghub I have worked as a developer in several large scale scraping projects. Some examples of these projects are:
* Implementation of broad crawler to process a large number of domains and extract link info. In this project we processed million of domains with a hundred of millions of crawled pages.
* Lead developer for project to extract providers data and resumes from more than a thousand sites. This project used manual extraction with some heavily customized parsing libraries. The project had a team of several programmers working for more than a year to complete.
Currently I am also working as part of the Sales team, involved in the design and technical evaluation of new projects.