I need a Windows program that will periodically get a list of URLs of websites from a central server (which we call a JobServer), fetch the URLs' HTML or binary data efficiently & simultaneously, and progressively post the data back to the JobServer. Specific requirements: • the fetcher should install and work automatically on windows XP, Vista, and Windows 7 (double-click installation, no confirmation steps, *shouldn't* rely on prerequisites that are not part of a barebones XP/Vista/W7 installation). basically, it should just work with no caveats. • when getting more than one URL in the list from the JobServer, the URLs should be fetched simultaneously, up to eight at a time. • polling of the main server should be done once each hour, or immediately after the most recent post back to the JobServer. if the hourly fetching time happens to be in the middle of the processing of a previous job, the poll should still take place as scheduled and the new job's URLs should be fetched within a new set of up to eight downloads at a time. • posting of the responses back to the JobServer should be done progressively while the response from the website is being received by the fetcher. this is because some of the URLs fetched are huge files that can't be stored locally and therefore the situation of a fetch extending for more than an hour may happen as described in the previous bullet. • a detailed log of the fetcher's activity should be saved to a local file You may use any free libraries (GPL etc.) within this project. I don't have a mild preference that this be developed in C++ but am open for suggestions if you prefer to use some other platform. To bid on this project please specify: • which platform will you choose for development? • which libraries will you use? • how quickly can you deliver this project? Thanks!
1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.
2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables):
a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.
b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.
3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).
Windows, either C++ or another language you may choose