I need a web crawler built that will move across a website and collect data from it and then store that data in a simple database, preferably access.
The site in question is a free directory that list names and phone numbers of businesses. We have been manually collecting this information and it is very labor intensive.
The site is free to access, though we have recieved error messages when we have run to many page views off of it.
We would like an application built that would allow us to mine data off of this website on demand.
Our staff is very familiar with managing technology projects, but we are do not have the staff in house to build this application.
1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.
2) Installation package that will install the software (in ready-to-run condition) on the platform(s) specified in this bid request.
3) Exclusive and complete copyrights to all work purchased. (No GPL, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site).
We are open to differnt operating system. We currently have applications that run on Windows 2000 Server and Linux. We would prefer Windows.