Scraping Application
Orçamento $100-300 USD
Website Scraping Project Specifications:
I need either a Windows desktop based, or a web based application that I can host on a Linux Server, to scrape data from individual dealership listings from either [url removed, login to view] or Cars.com. I do not need to scrape either entire site. Each dealership has from maybe 10 to 200 or more vehicles on separate, linked pages. These specific dealership listings are what I need the data from. I will need to process only one dealership's listings at a time. I will need to be able to simply select whether the vehicle listings are from [url removed, login to view] or [url removed, login to view], paste in the individual dealership URL (see below for example URLs), and have the specified results data for that specific dealership exported via a specific tab delimited file format (see uploaded text file as example).
Here are example dealership listings from [url removed, login to view]:
[url removed, login to view];dealer_id=58243828&sort_type=make_modelASC&car_id=null&result_car_id=null
[url removed, login to view];dealer_id=100014504&sort_type=make_modelASC&car_id=null&result_car_id=null
Here are example dealership listings from [url removed, login to view]:
[url removed, login to view];searchType=26&cid=&dlid=159056&dgid=&amid=&cname=Auto+Trend&rd=&ddrd=&zc=32931&makeid=&modelid=&pageNumber=0&numResultsPerPage=50&largeNumResultsPerPage=0&sortorder=descending&sortfield=PRICE+descending&certifiedOnly=false&criteria=C-159056%7CK-%7CE-%7CN-N%7CR-%7CI-1%7CP-PRICE+descending%7CQ-descending%7CZ-32931&aff=national&aff=national
[url removed, login to view];searchType=26&cid=&dlid=170256&dgid=&amid=&cname=Carport+of+Orlando&rd=&ddrd=&zc=32931&makeid=&modelid=&pageNumber=0&numResultsPerPage=50&largeNumResultsPerPage=0&sortorder=descending&sortfield=PRICE+descending&certifiedOnly=false&criteria=C-170256%7CK-%7CE-%7CN-N%7CR-%7CI-1%7CP-PRICE+descending%7CQ-descending%7CZ-32931&aff=national&aff=national
The fields for the specified results are as follows:
The current date
Stock number
VIN
Price
Year
Make
Model
Engine
Exterior Color
Interior Color
Mileage
The specific exported data file format is tab delimited as per the attached example.