We need programmer that can do C# or VB gui. The gui needs to be multi threaded (1- 1000).
It needs to run of the MySQL DB and work on all Windows OS (ME, XP, NT, 2000).
The gui has to be very fast and accurate.
It needs to do the following:
1. Retrieve url from the MySQL table
2. Crawl every page on that URL
3. Save all the information from each page crawled to the HD
4. From each page crawled retrieve all the links on that page and insert them in the DB or update them if that particular page already exits
5. The gui that runs this process needs to be able to keep track which page has been crawled, what time, page, etc
6. It needs to allow me to set minimum days since last crawl so if I need to recheck some pages I can
7. GUI needs to be able to be stopped and start as I need it
8. GUI needs to let me pick amount threads that I want to run
9. GUI needs to be able to run multiple copies of its self on same or multiple computer at the same time
10. I need complete rights to this program and all the source code
11. GUI needs to look good and be easy to use
This is not all the things that gui will do but it is the most of the important things.
I need someone that can start ASAP and do a lot of work for us in the future.
18 freelancers are bidding on average $91 for this job
Hello, I can fullfil your all 11 requirements using VB.NET within 4 days. I already done 9 project to crawl info from web sites. Expecting to work for you, Sincerely, Senthilkumar D.
Hello. I am ready to start as soon as you want. What version of mySql do you want to use for this? Can I have a look at the DB structure (if you can send me a diagram or sample)? Regards, Dejan