We need someone to build a spider which will pull all of the products from this site:
[url removed, login to view]
and insert it into a MYSQL database.
This Script Must Be Written in PHP.
The script will not only pull down the products but also the categorisation of the products.
(See the Blue/Purple Striped Box on Left of Page)
Images will also be saved.
Each product will be assigned a consecutive product_id number beginning with 1.
NOTE: this must not be an autoincrement field, suggest that you have another field for the primary key which is not related to our data structure.
If a product is in more than one category, then the listing will be repeated entirely, but with the alternative category structure for each instance of the product in a category (this is why the product_id must not be an auto_increment primary key).
Please see attached file for an example of the final [url removed, login to view] layout we require. Its up to you whether you opt to create this exact layout in Mysql - or you can create a 2 table system with a products table and a categories table.
If you opt for the two table option, you must also create the script for recombining these 2 mysql tables to output the .txt format file
If you need any help understanding this file or the data on the site to be spidered, please use the project message board.