Encerrado

Write script or code to harvest data from websites

### SIMPLE DESCRIPTION ###

I would like someone to write a semi automated script/code or software that will search [login to view URL] using a custom search criteria. It will then collect all the addresses of all the properties that appear in the search and save them.

Then I need a second script/code or software to search all the saved addresses on another website and collect additional data which will be saved in a Microsoft Access Database (.mdb) file for a mail merge.

### DETAILED STEP BY STEP EXAMPLE ###

1) Search [login to view URL] for rental properties in Toowong, QLD 4066 using the following search criteria:

- All property types

- Beds (min): any

- Beds (max): any

- Price pw (min): $350

- Price pw (max): any

- Available date: Any date

- Surrounding suburbs: no

[login to view URL],+qld+4066/list-1

PLEASE NOTE THAT THE SEARCHES WILL ALWAYS BE FOR "RENT" SECTION OF THE WEBSITE, BUT I WILL NEED THE ABILITY TO MODIFY ALL THE OTHER SEARCH CRITERIA

2) The script will then collect all the addresses for all the properties that appear in this search. Please note that several pages appear in the search. eg:

- [login to view URL],+qld+4066/list-1

- [login to view URL],+qld+4066/list-2

- [login to view URL],+qld+4066/list-3

- [login to view URL],+qld+4066/list-4

and all the addresses must be saved, eg:

- 1/39 Brisbane Street, Toowong, Qld 4066

- 2/21 Glen Road, Toowong, Qld 4066

- 601/2-6 Land Street, Toowong, Qld 4066

- 204/573 Coronation Drive, Toowong, Qld 4066

- etc etc

3) all the saved addresses will then be used to search on https://rpp.rpdata.com.... Please note that this website requires a paid account and login which will be supplied by myself.

4) The script will search all these addresses one by one. Please see image 1 for an example of the first address search. PLEASE NOTE THAT ENTERING THE ADDRESS AND PRESSING 'ENTER' DID NOT FIND THE PROPERTY. I had to click the correct address from the drop down box first. Please also note that some properties will not be found and the script needs to be able to filter out as many as possible.

5) Please see image 2 for search results for first property

6) Please see image 3 and 4 for the data shown for that property

7) The script will then collect the address shown in the 'ownership' section. PLEASE NOTE THAT I HAVE HIDDEN THE EXACT ADDRESS FOR PRIVACY REASONS.

eg:

46 XXXXGTON TCE

ROBINA QLD 4226

8) Data collected will then be saved in an .MDB file. Please see image 5 for the format to be used. Please note that the addresses need to be split into columns as shown in image 5.

- 'Owner Address Line1' is the first part of the address that was found in step 7

- 'Owner Address Line2' is the second part of the address that was found in step 7

- 'Field1' is the address collected in step 2

- 'Rental Suburb' is the suburb taken from 'Field1'

#########

I am open to suggestions. If any of this script is too difficult/expensive to write then please recommend a better option. Some parts can be manual if needed.

Please message me if you are interested. I will be ignoring automated bids so please show that you understand the job and explain how you will do it :)

Habilidades: Javascript, MySQL, PHP, Arquitetura de software, Captura de dados na web

Veja mais: write code transfer data sql server excel, collecting data websites php script, create script harvest data, extract data from webpage, scrape data from website python, extract data from website to excel, web scraping tutorial, html scraping, web scraping, how to download data from website using python, script to pull data from website, script read data websites, script scrape data websites, write java script code odd numbers, write script macro copy data website excel, write script copies data excel clipboard, showing data count field pivot script code, data scraping php script code, php script request data websites, script bot gather data websites

Acerca do Empregador:
( 41 comentários ) Hawthorne, Australia

ID do Projeto: #17977086

45 freelancers estão ofertando em média $1180 para esse trabalho

tarunmehan

Hello, Greetings for the day! I am ready to help you on an immediate basis to develop script that will search [login to view URL] using a custom search criteria. I have 5+ years of experience in PHP, Wordpress, Mais

$1200 AUD in 24 dias
(81 Comentários)
7.6
pointlogic

Hello, I always provide fastest results with quality. I have an experience of more than 10 years in web development and maintenance. I have in-depth knowledge of php, mysql, javascript , jquery, payment system integrat Mais

$750 AUD in 20 dias
(311 Comentários)
8.1
seaanddream

Hi, my name is Selim. I will write a java based bot with a sipmle UI for you to enter your search criteria and run it easily... I read your `[login to view URL]` project descriptions carefully before bidding. I checked Mais

$900 AUD in 7 dias
(253 Comentários)
7.7
mhmhz

Hi I checked your requirements and i can build fully automated scrapers that can do the search then utilize the addresses. and finally export data to Access DB. PS. the scraper will be a desktop application that Mais

$3000 AUD in 5 dias
(202 Comentários)
7.7
raindropsin

#Scrapping It seems like I need to create SCRIPT which scrapes data from that [login to view URL] real estate website and after gathering that data, need to store it and then also search that address with Mais

$2000 AUD in 20 dias
(106 Comentários)
7.7
AndreiMk

Hi, I visited [login to view URL] to see how it works and reviewed your screenshots. I would suggest to make it as a standalone Windows application for the following reasons: - if it is for your personal use, why ma Mais

$1250 AUD in 14 dias
(111 Comentários)
7.4
phpdeveloper100

I am expert in scrapping data from other website with all criterias as needed genraly , sometimes using proxies also , Please open Message box so that we discuss it in detail Expertise ================== - PHP Mais

$1186 AUD in 20 dias
(73 Comentários)
7.2
ineedWorkJob

Greetings sir, how are you today sir? hope fine. Sir, I have read your project details and i will develop a windows software that will scrap the data from your 1st website based on your set parameters on the sof Mais

$1000 AUD in 5 dias
(188 Comentários)
7.1
junkyfunky

Hello, I've read your project description and I want to tell you that I can write a semi automated script for you that will search [login to view URL] using a custom search criteria exactly as per your requirements. Mais

$750 AUD in 8 dias
(135 Comentários)
6.9
kyrbatow

Hi. I think, all steps are possible to implement. I can use phantomjs to use the same actions as real user. Also I can use http requests. For example, step on screeenshot 1. When you fill in address text, site retu Mais

$1000 AUD in 20 dias
(67 Comentários)
6.8
superman1987417

Greeting. Thanks for your job posting. I've read your job posting carefully and I am very interested in it. As a high skilled Scraping expert, I can do your job perfectly. I believe I possess the all required ski Mais

$1500 AUD in 20 dias
(74 Comentários)
6.9
bestit4u

hi Nice to meet you. I read your job posting and I am very interested. first, Thanks for your detailed description. I think you want to make a automation bot. Yes. I have a good experience in building automation Mais

$1250 AUD in 20 dias
(116 Comentários)
7.2
WebColorIn

All you need is a Chrome extension. Easy to use and customize, add features as well. I will build extension UI so its friendly to use. Will need API ( I will do this) that will post data to sql database if required. Mais

$1500 AUD in 25 dias
(54 Comentários)
6.7
luiswilliam

Hi, how are you? I'm talented web developer. I have completed lots of professional web projects successfully before. And I am continuously supporting all projects which I have done for clients.,.,,///;' However, I' Mais

$1250 AUD in 20 dias
(65 Comentários)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with scraping [login to view URL] ! I can start immediately a Mais

$1111 AUD in 10 dias
(68 Comentários)
6.8
polarjin2017

Hello? How are you? I have good skills in So I can complete your job in time. Hope to work with you. Thank you.

$800 AUD in 3 dias
(99 Comentários)
6.7
devi222

Hi Sir, I have scraped the [login to view URL] site before for buy, rent, sold and agents data. I can create a python 3.6.5 script(GUI) will allow you to keep the addresses in the text file or excel file as a list and h Mais

$1000 AUD in 5 dias
(110 Comentários)
6.5
schoudhary1553

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid Mais

$1500 AUD in 20 dias
(61 Comentários)
6.4
Batista111

Hello, Similar website [login to view URL] Please have a look at my freelancer profile. https://www.freelancer.com/u/Batista111 As you can see I have worked on more than 100 projects includin Mais

$1250 AUD in 20 dias
(111 Comentários)
6.6
novepi

Hi there, I've checked each and every step individually, the requirements are quite clear. To be honest, I'm truly surprised to see that there's no serious measure for bot mitigation on [login to view URL] so this par Mais

$1000 AUD in 5 dias
(47 Comentários)
6.1