I want a tool to help me copy dynamic websites & search engines results which are in many pages. The tool I want should do this. Take the URLs I input and visit all the results pages and save them locally. For example: [login to view URL] will give you around 800 results which will be in 100 pages. The tool will click through "next" to each results page and save the page in the local machine. I ONLY WANT TO GET THE SEARCH RESULTS PAGES FROM VARIOUS SITES AND NOT DOWNLOAD ENTIRE SITES. You will appreciate that these pages are typically dynamic pages resulting from a search of the database on the site. I want this to work with not only the search engines but with any website. Since all sites will not have the same pattern in the HTML code, if you want me to analyse the HTML code for each site and configure how the "next" will work, I can do that. I am mostly interested in the text content of the results pages. So, just save the page as a HTML page without the images. Occasionally, I may want the images also. So, you need to give an option to save the images. I should be able to do this for all sites without any exceptions. You can create this as a stand-alone application or as a browser plug-in. I use FireFox but I also have IE installed. Each operation will be a project which can be saved so that the settings can be reused. Settings will be: destination of the HTML files, image files (if selected), naming pattern for HTML file (characters plus serial number, or running serial or filename in the site etc), timeouts etc. I plan to add more features to this product. So, if this phase works out well you can help me with the next phase as well.
## Deliverables
1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.
2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):
a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.
b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.
3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).
## Platform
Windows XP, 2000