I have a new project I need completed ASAP, so be accurate with your timeline. Summary: This project is to build a crawler to extract data from a specified shopping cart system. Also to create the interfaces and db's. Every Aspect of this needs to be created: 1) Select a url to crawl on a simple interface 2) the interface sends the selected url and specified module (that corresponds with the shopping cart on that url) to use, to the crawler 3) crawler uses the specified module to crawl the specified url and extracts the information (product data (Product | Part Number | Price | Shipping Cost | URL of Product) & record the visit to site date into a db (MYSQL)) 4) The data can then be viewed through a simple interface 5) After this project is completed I will give you the opportunity to develop more modules for this system Items to develop (detailed): 1) Crawler - I currently have a really fast crawler that could be duplicated and altered to work with this system (so you don't necessarily have to create a brand new crawler, to save time) or you can develop a brand new crawler that should be very fast and efficient and follow all 'crawler rules' 2) simple interfaces - I will provide the html layouts 3) Corresponding db's 4) yahoo store module - this module should be developed to be used by the crawler and when used it will extract the product data (product data (Product | Part Number | Price | Shipping Cost | URL of Product) from the entire site and store it into a unique db Entire system should be very fast. I have many crawler programs currently so I will know if it is slow due to bad programming. - You will be required to send a status email EVERYDAY. - This should be built on my dedicated server so I can view if the coder isn't working. (I have coders with high feedback ratings disappear on me without a word everyday) - Do NOT BID if you do not agree to any of the terms on this page -
1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.
2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables):
a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.
b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.
3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).
Free BSD & MYSQL