Master-Scraper with modules for each website

I would like to scrape several recruitment agency websites with job listings in regular intervals.

Tool needs to scrape the websites every X hours (e.g. 48) and save the output into one single XLSX file. Ie all scraped data goes into this one file, file gets constantly updated but we avoid duplicate records in it.

Multi-threading would be preferred.

You can use any programming language but I need the full source code plus a program which runs on my Windows PC (normal exe, no need to run as a service).

Frontend GUI: Show a grid with all modules which are currently implemented in the tool (every website must have its own module), allow user to select/deselect which modules shall run. BUtton "Start" to launch scraping manually. Checkbox "Automatic mode" if checked then launch scraping immediately and then every X hours from last scraping.

Will provide details of how to scrape the various websites.

This is a project which can ultimately contain up to 100-200 websites. At the beginning I need the master scraper and 3 modules. If it works we will add additional modules afterwards and I will pay you on a per module basis.

If you bid for this project let me know if you can do multi threading, and which programming language you will use.

I am looking for someone to work on this long term. Will prefer Ukrainian, Russian or Eastern European freelancers. No bids from India, Pakistan or Vietnam please.

Habilidades: Captura de dados na web

Veja mais: work with russian language, works for freelancers, work for freelancers websites, websites with freelancers, websites looking for freelancers, website programming tool, web service in india, web scraping freelancers, web agency india, threading programming, service-master, russian looking for job, russian language job, recruitment of freelancers, recruitment freelancers website, recruitment freelancers, recruitment agency job, programming project for freelancers, looking for recruitment job, looking for recruitment agency freelancers, looking for job as freelancers, launch recruitment, job with russian, job for russian, it freelancers from india

Acerca do Empregador:
( 77 comentários ) Singapore, Singapore

ID do Projeto: #6838046

16 freelancers estão ofertando em média $250 para esse trabalho


Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of my similar experience: Amazon/Ebay Bots: [login to view URL] Mais

$210 USD in 5 dias
(44 Comentários)

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$267 USD in 6 dias
(94 Comentários)

Hi i can provide a multi-hreading desktop application. can you provide the initial 3 sites and which data need to be extracted? can work on a demo if you like thanks

$555 USD in 4 dias
(32 Comentários)

Hello Sir, I worked at [login to view URL] which is the used cars search engine. There I developed a system that is much like what you need - a master scraper with modules for each site. We had around 1000 sites that we scraped Mais

$400 USD in 5 dias
(31 Comentários)

Dear employer, I've very good experience in web scraping. I can scrape the jobs sites as per your requirement. I can provide you a java jar file which can be run from any OS. Hope this works for you. Please send in m Mais

$99 USD in 5 dias
(33 Comentários)

This is exactly my area of specialty. Given your requirement for a controller GUI I propose using two languages. Each of them the best to accomplish their task. I would use C# to develop the master scraper where y Mais

$250 USD in 7 dias
(4 Comentários)

Hi, we'd be very glad to build such application. However before making long introductions, I do have a few questions to clarify the project: Could you provide a little more detail in regards to the desired output ( Mais

$200 USD in 14 dias
(1 Comentário)

I am expert in scraping and data processing, I can scrap any website using php, benefit of PHP scraping is that we can put it on server and whole process go automatic without need to open our pc, message me for full de Mais

$60 USD em 1 dia
(2 Comentários)

Hi We can assure you that we are having the best web scraping tool and experience and we can scrape any website to get any kind of information. We are a team 5 professional and all of us carry around 10 yrs of Mais

$210 USD in 6 dias
(2 Comentários)

Seeing is believing, Let our work speak on our behalf. [login to view URL] We extract from the following:- 1. [login to view URL] 2. [login to view URL] 3. http://ww Mais

$250 USD in 4 dias
(2 Comentários)

Dear Client, Greeting of the day ahead !!! Thanks for providing us opportunity to place bid over the project and communicate with you. I am a serious bidder here and i have already worked on a similar project befor Mais

$155 USD in 3 dias
(0 Comentários)

Hi! I’m a highly skilled Software Developer from Russia, specialized in various web-automation tools, web-scrapers, crawlers, data extractors, automated posters, human behavior emulators and so on. I’ve successfully de Mais

$250 USD in 10 dias
(0 Comentários)

Hi Alex Do you remember I successfully completed several Delphi projects for you some time ago? And I would be glad to work with you again. I'm interested in your Master-Scraper project. I have serious experience Mais

$400 USD in 12 dias
(0 Comentários)

Hi, Iam interested in your project and I'll be happy to do that for you. I have rich experince in scrapping curl regular expressions Dom and Selenium RC. i can do multi threading using PHP python and ruby. I am Mais

$155 USD in 3 dias
(0 Comentários)

Hello! I'm native Russian speaker. Have a great experience in PHP, MySQL. Frontend: Javascript, Jquery, AJAX, HTML5, CCS3. Previous 5 years have been working on position of Web developer. Have graduated Computer Acad Mais

$388 USD in 6 dias
(0 Comentários)

We will write scraper at a cost of $100/site 1. Crowd Funding Site In these days we are already near to finish a full CMS based crowd funding site which is a clone of kickstarter but we implemented many unique Mais

$247 USD in 7 dias
(0 Comentários)

I have already scraping tools to scrape any website. I have many years of experience in Data Entry and Web Research. I put a lot of effort into perfecting every task handed to me. I can help with any admin, virtual, Mais

$55 USD in 3 dias
(0 Comentários)