Em Andamento

Scrape 4 Dutch websites for data - repost


For marketing research we need to collect public data from 4 websites.

For all information please see: [url removed, login to view]


* PHP as programming language.

* Use CURL library for HTTP requests.

* PHP script should be run in commandline.

* Efficient crawler to minimize number of requests.

* Store data in MySQL database.

* Configuration part in the script which sets database user/pass/dbname and other settings in one place.

* Possibility to stop the script and to continue where is left off. Do not crawl already crawled data more than once.

* If data already exists in the database, do not scrape it again.


* Not every scraped site has all informatie. If one site has not information XX, then NULL must be put in the database.


* Database structure for MySQL tables.

* One PHP script, which can be run in command line. This script fills the database with data from the websites.


There are two milestones:

1. 50% when script is running and working, so it can be tested and

2. 50% when everything is checked to be working properly.

For all information please see: [url removed, login to view]

Habilidades: MySQL, PHP, Captura de dados na web

Ver mais: websites programming, use data structure programming, use data structure, need marketing research, tables data structure, sets data structure, requirements marketing, programming data, programming data structure, php script null, data structure programming, data structure library, language dutch, programming websites, crawl data, dutch websites, store data database php, mysql library, crawled data, crawler programming, curl data, working data repost, programming php crawler, public crawler data, run curl script

Acerca do Empregador:
( 9 comentários ) HENGELO OV, Netherlands

ID do Projeto: #5103421

6 freelancers estão ofertando em média €118 para este trabalho


Hi. I'm Trong. I have experience with php, curl, and scrape script. You can see my reviews. I can make for you this project. Regards, Trong.

€150 EUR in 5 dias
(17 Comentários)

I can Scrape 4 Dutch websites that you mentioned in description and Export data into MySQL tables. Let's start the project.Have a nice day. Thank you

€30 EUR in 3 dias
(9 Comentários)

I am an experienced web developer. I have done this before many times. I have scraped data from Amazon, YourTube, browser games, e-shop and so on. It doesn't not matter if getting the data requires authentication or if Mais

€30 EUR in 3 dias
(1 Comentário)

Greetings,Hello Sir, I have gone through your project requirements and we have highly skilled and qualified team who own all the right credentials to execute this job in a very proficient manner as per your exact requi Mais

€263 EUR in 5 dias
(2 Comentários)

Hi there, I have gone through your requirements and would say i can help you with this.We are professional web developers team having 6+ years experience in similar development. Please have a look my portfolio fo Mais

€205 EUR in 7 dias
(0 Comentários)

Scraping the data is no problem and running the PHP from cli is ok, but please inform me of which version of PHP you would prefer as some of the newer features will break on older versions. Can provide a normalized for Mais

€30 EUR in 7 dias
(0 Comentários)

Hello Ma’am/Sir, Greetings to you from Globussoft, We are the masters of Scraper development and have over 350+ scrapers in our product list.We can definitely make your scraper directory. We have made a lot of s Mais

€19 EUR in 7 dias
(0 Comentários)