Encerrado

Master-Scraper with modules for each website

I would like to scrape several recruitment agency websites with job listings in regular intervals.

Tool needs to scrape the websites every X hours (e.g. 48) and save the output into one single XLSX file. Ie all scraped data goes into this one file, file gets constantly updated but we avoid duplicate records in it.

Multi-threading would be preferred.

You can use any programming language but I need the full source code plus a program which runs on my Windows PC (normal exe, no need to run as a service).

Frontend GUI: Show a grid with all modules which are currently implemented in the tool (every website must have its own module), allow user to select/deselect which modules shall run. BUtton "Start" to launch scraping manually. Checkbox "Automatic mode" if checked then launch scraping immediately and then every X hours from last scraping.

Will provide details of how to scrape the various websites.

This is a project which can ultimately contain up to 100-200 websites. At the beginning I need the master scraper and 3 modules. If it works we will add additional modules afterwards and I will pay you on a per module basis.

If you bid for this project let me know if you can do multi threading, and which programming language you will use.

I am looking for someone to work on this long term. Will prefer Ukrainian, Russian or Eastern European freelancers. No bids from India, Pakistan or Vietnam please.

Habilidades: Captura de dados na web

Ver mais: work russian language, works freelancers, work freelancers websites, websites looking freelancers, website programming tool, web service india, web agency india, threading programming, russian language job, recruitment freelancers website, recruitment freelancers, recruitment agency job, programming project freelancers, looking recruitment job, looking recruitment agency freelancers, looking job freelancers, launch recruitment, need job recruitment, know website programming language, know programming language website, freelancers website works, code programming language, frontend freelancers, freelancers service websites, freelancers programming job

Acerca do Empregador:
( 76 comentários ) Singapore, Singapore

ID do Projeto: #6838046

16 freelancers estão ofertando em média $250 para este trabalho

SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of my similar experience: Amazon/Ebay Bots: http://sigma-dns.sigmavirtual.com/PD Mais

$210 USD in 5 dias
(44 Comentários)
6.5
mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$267 USD in 6 dias
(94 Comentários)
6.5
mhmhz

Hi i can provide a multi-hreading desktop application. can you provide the initial 3 sites and which data need to be extracted? can work on a demo if you like thanks

$555 USD in 4 dias
(32 Comentários)
6.3
dusmanija

Hello Sir, I worked at ooyyo.com which is the used cars search engine. There I developed a system that is much like what you need - a master scraper with modules for each site. We had around 1000 sites that we scraped Mais

$400 USD in 5 dias
(31 Comentários)
6.0
proauthor

Dear employer, I've very good experience in web scraping. I can scrape the jobs sites as per your requirement. I can provide you a java jar file which can be run from any OS. Hope this works for you. Please send in m Mais

$99 USD in 5 dias
(33 Comentários)
5.1
JoaoRoque

This is exactly my area of specialty. Given your requirement for a controller GUI I propose using two languages. Each of them the best to accomplish their task. I would use C# to develop the master scraper where y Mais

$250 USD in 7 dias
(4 Comentários)
3.7
cyberguard

Hi, we'd be very glad to build such application. However before making long introductions, I do have a few questions to clarify the project: Could you provide a little more detail in regards to the desired output ( Mais

$200 USD in 14 dias
(1 Comentário)
3.1
gomcodoctor

I am expert in scraping and data processing, I can scrap any website using php, benefit of PHP scraping is that we can put it on server and whole process go automatic without need to open our pc, message me for full de Mais

$60 USD em 1 dia
(2 Comentários)
2.9
ayanbishnu

Hi We can assure you that we are having the best web scraping tool and experience and we can scrape any website to get any kind of information. We are a team 5 professional and all of us carry around 10 yrs of Mais

$210 USD in 6 dias
(2 Comentários)
1.8
varun8211

Seeing is believing, Let our work speak on our behalf. http://dev1.galaxyweblinks.com/dataextractiondemo/ We extract from the following:- 1. http://www.missguidedau.com 2. http://www.showpo.com 3. http://ww Mais

$250 USD in 4 dias
(2 Comentários)
1.4
metasoft5

Dear Client, Greeting of the day ahead !!! Thanks for providing us opportunity to place bid over the project and communicate with you. I am a serious bidder here and i have already worked on a similar project befor Mais

$155 USD in 3 dias
(0 Comentários)
0.0
makarigor

Hi! I’m a highly skilled Software Developer from Russia, specialized in various web-automation tools, web-scrapers, crawlers, data extractors, automated posters, human behavior emulators and so on. I’ve successfully de Mais

$250 USD in 10 dias
(0 Comentários)
0.0
exansoft

Hi Alex Do you remember I successfully completed several Delphi projects for you some time ago? And I would be glad to work with you again. I'm interested in your Master-Scraper project. I have serious experience Mais

$400 USD in 12 dias
(0 Comentários)
0.0
chromax2000

Hi, Iam interested in your project and I'll be happy to do that for you. I have rich experince in scrapping curl regular expressions Dom and Selenium RC. i can do multi threading using PHP python and ruby. I am Mais

$155 USD in 3 dias
(0 Comentários)
0.0
retqqqq

Hello! I'm native Russian speaker. Have a great experience in PHP, MySQL. Frontend: Javascript, Jquery, AJAX, HTML5, CCS3. Previous 5 years have been working on position of Web developer. Have graduated Computer Acad Mais

$388 USD in 6 dias
(0 Comentários)
0.0
buraqtech

We will write scraper at a cost of $100/site 1. Crowd Funding Site In these days we are already near to finish a full CMS based crowd funding site which is a clone of kickstarter but we implemented many unique Mais

$247 USD in 7 dias
(0 Comentários)
4.6
papawady146

I have already scraping tools to scrape any website. I have many years of experience in Data Entry and Web Research. I put a lot of effort into perfecting every task handed to me. I can help with any admin, virtual, Mais

$55 USD in 3 dias
(0 Comentários)
0.0