Write some Software
$750-1500 USD
Pago na entrega
I am looking to get the same info from two different types of pages:
type one: generic search using amazon filters to provide urls:
http://www.amazon.co.uk/s/ref=sr_nr_p_n_availability_1?rh=n%3A340831031%2Cn%3A428654031%2Cn%3A430439031%2Cn%3A6411151031%2Cn%3A430484031%2Ck%3Acomputer+part+supply%2Cp_6%3AAUCLXU4CMAQOY%2Cp_n_availability%3A419162031&keywords=computer+part+supply&ie=UTF8&qid=1455497320
type two: specific product:
Can be either of these two urls as both are generated with Asin and I will have Asins of products I am interested in:
[login to view URL]
[login to view URL]
The info I would like is:
Asin: Amazon Unique Identifier
Title: Name
Fulfillment Channel: Merchant or FBA
Availability: In stock or no
Price: I only care about the lowest price that is FBA
Review Count: Number of Reviews (not a priority)
Category: (not a priority)
Brand: (not a priority)
Web Crawler should be written in Python, and be executable from the command line on AWS servers. If you choose to use a VPN network, details for setting up or maintaining that network should be provided. The code should be accompanied with documentation (a README or comments) explaining the structure of the system and any particular nuances that should be understood. We will provide credentials for writing to a table in our PostgreSQL database system. The output of your software should be written to this table.
I would like a plan for scalability as amazon doesn't like its website crawled. Will you use a revolving vpn, how many instances of aws to run simultaneously, etc
I would like to do a minimum of 500K urls a day
ID do Projeto: #9688818
Sobre o projeto
11 freelancers estão ofertando em média $1257 nesse trabalho
Hello: Greeting for the day! We have gone through your job post and are very excited about bringing your project on board. We are design and development company and providing outsource services. We will deliver y Mais
