I need a script which does the following: A script that crawls pages of a certain project and saves them. Those URLs can be included as a list of html-Links on any php-page on the web. Here is how it should work: The script will be installed on server “A?? and is password protected. Administrator can create different “Projects?? and give them a name. For each Project the admin will have to tell the script, on which URL the Project is placed. Let’s say Project 1 has the following URL: [url removed, login to view] The Script will then send a crawler every week to crawl all pages that are placed behind the folder [url removed, login to view] Like [url removed, login to view] [url removed, login to view] etc…. the script will grab the URLs found and the TITLE of each page found and save it. The admin will get a php-include-code for Project 1 by the script. So he will be able to include that Project 1- code on any php-page in the world. If he includes it on a page, the script will send a list of URLs it has found on Project 1 (URLs displayed randomly every time you hit reload). The admin will have to set how many URLs should be displayed at once. This list will look like: [title of that page]
[title of that page]
etc……. that’s it. Remember, that the script will have to be intelligent enough to connect relative links to the URL it has found them on. Alternatively for the spider: If you don’t want to program a spider, you could alternatively go to google and use the “site: [url removed, login to view]? - Command to grab URL and title of all pages of that project :-)
2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables):
a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.
b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.
Linux PHP, MySQL - if needed