PHP Crawler / Spider

I need an experienced developer that can write an php application that has crawler type of functionality that will do the following things:

1. Have the crawler go to a number of specified websites every day at a time that I specify (automated time) or when activated manually, login with a username and password that I will also specify (I should be able to type in this information into the application’s interface).

2. Retrieve product information form my suppliers website and then update my website, This may include images. (if the images already exist on my site then the application should not download the images again)

3. It also then needs to be able to apply a margin (the margin will be based on several variables) and courier costs (the courier cost is a flat rate) to the pricing information retrieved from my suppliers website. (I should be able to type in this information into the application’s interface)

4. I want to be able to configure the crawler for different sites. Ease-of-use in this process is important.

5. Must be able to deal with any site and extract any type of information.

6. The crawler should be very fast, not slow due to bad programming.

7. The web crawler must be able to put all of the products in to categories such as Video cards, CPU’s and so on.

8. Different Websites may use different categories - I will need to be able to merge categories from my suppliers website with categories on my website or create new ones with in the applications interface.

All providers must have your own test server so that I can preview a working model of the crawler before it is implemented into my live site

You must be available in the future for paid maintenance and further development.

Habilidades: PHP

Veja mais: php crawler, php crawler spider, best php crawler, write crawler php, image spider php, write spider php, php curl crawler, working of web crawler, web developer providers, web developer pricing, web developer costs, web crawler developer, web application development cost, test for php developer, programming a website costs, php programming test, php programming in video download, php development sites, php developer information, new product development process, it developer php, download php 5.3, c programming web crawler, cost of applications, bad programming

Acerca do Empregador:
( 10 comentários ) Lower Hutt, New Zealand

ID do Projeto: #161456

Concedido a:


I'm able to do it but in Perl. PHP is not a good idea. Please see PM.

$200 USD em 10 dias
(4 Comentários)

5 freelancers are bidding on average $218 for this job


Dear Client ---- Thanks you for opportunity to bid on your project ---- We have already experience of working on related projects, and we can develop your required script in php/curl ---- Please check PM fo Mais

$300 USD in 7 dias
(245 Comentários)

Hi I'm interested in PMsent.

$290 USD in 10 dias
(7 Comentários)

I can do it,please select me.

$100 USD in 3 dias
(0 Comentários)

We will Serve you in a better way as we have a Experienced guys who has about 10 years of experience.

$200 USD in 7 dias
(0 Comentários)