I would like to scrape several recruitment agency websites with job listings in regular intervals.
Tool needs to scrape the websites every X hours (e.g. 48) and save the output into one single XLSX file. Ie all scraped data goes into this one file, file gets constantly updated but we avoid duplicate records in it.
Multi-threading would be preferred.
You can use any programming language but I need the full source code plus a program which runs on my Windows PC (normal exe, no need to run as a service).
Frontend GUI: Show a grid with all modules which are currently implemented in the tool (every website must have its own module), allow user to select/deselect which modules shall run. BUtton "Start" to launch scraping manually. Checkbox "Automatic mode" if checked then launch scraping immediately and then every X hours from last scraping.
Will provide details of how to scrape the various websites.
This is a project which can ultimately contain up to 100-200 websites. At the beginning I need the master scraper and 3 modules. If it works we will add additional modules afterwards and I will pay you on a per module basis.
If you bid for this project let me know if you can do multi threading, and which programming language you will use.
I am looking for someone to work on this long term. Will prefer Ukrainian, Russian or Eastern European freelancers. No bids from India, Pakistan or Vietnam please.
16 freelancers are bidding on average $250 for this job
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
Hi i can provide a multi-hreading desktop application. can you provide the initial 3 sites and which data need to be extracted? can work on a demo if you like thanks