10+ mio scraped articles ...
... scraped from one of the big article directories (which is very aggressive in blocking scraping attempts).\n\nScrape took 4 days as I had to use lot of proxies.\n\nThis much data can\'t be loaded into excel that\'s why I\'m showing this commandline dump.
About Me
Software engineer (with almost 20 years experience) helping companies to extract/scrape, transform and analyse complex data from the internet and APIs into high quality structured datasets - even if the data source is difficult to access due to technology used or aggressive protection. Responsible and dedicated professional with attention to detail, delivers on time and within budget. Prefered technology Python and R as these are the most powerful tools in the area of data scraping and data mining (used by big companies like Google, etc) Using these technologies I can deliver on most scraping jobs within a few days or even hours. Results are statistically checked for quality (missing values etc). Also fluent in Javascript, jQuery, Node.JS, Ruby (on Rails), PHP and several other technologies to reverse engineer scraping target websites (if needed) as well as for creating and maintaining custom build scrapers.
NEW FREELANCER!
