Em Andamento

Scrape 4 Dutch websites for data - repost


For marketing research we need to collect public data from 4 websites.

For all information please see: [url removed, login to view]


* PHP as programming language.

* Use CURL library for HTTP requests.

* PHP script should be run in commandline.

* Efficient crawler to minimize number of requests.

* Store data in MySQL database.

* Configuration part in the script which sets database user/pass/dbname and other settings in one place.

* Possibility to stop the script and to continue where is left off. Do not crawl already crawled data more than once.

* If data already exists in the database, do not scrape it again.


* Not every scraped site has all informatie. If one site has not information XX, then NULL must be put in the database.


* Database structure for MySQL tables.

* One PHP script, which can be run in command line. This script fills the database with data from the websites.


There are two milestones:

1. 50% when script is running and working, so it can be tested and

2. 50% when everything is checked to be working properly.

For all information please see: [url removed, login to view]

Habilidades: MySQL, PHP, Captura de dados na web

Veja mais: websites programming, websites for programming, use of data structure in programming, use of data structure, the need for marketing research, tables in data structure, sets in data structure, requirements for marketing, programming with data, programming in data structure, programming data structure, programming and data structure, php script null, data structure programming in c, Data Structure programming, data structure in programming, data structure and programming, c with data structure, c++ programming websites, c data structure library, language in dutch, c programming websites, programming websites, crawl data, dutch websites

Acerca do Empregador:
( 9 comentários ) HENGELO OV, Netherlands

ID do Projeto: #5103421

6 freelancers estão ofertando em média €118 para esse trabalho


Hi. I'm Trong. I have experience with php, curl, and scrape script. You can see my reviews. I can make for you this project. Regards, Trong.

€150 EUR in 5 dias
(17 Comentários)

I can Scrape 4 Dutch websites that you mentioned in description and Export data into MySQL tables. Let's start the [login to view URL] a nice day. Thank you

€30 EUR in 3 dias
(9 Comentários)

I am an experienced web developer. I have done this before many times. I have scraped data from Amazon, YourTube, browser games, e-shop and so on. It doesn't not matter if getting the data requires authentication or if Mais

€30 EUR in 3 dias
(1 Comentário)

Greetings,Hello Sir, I have gone through your project requirements and we have highly skilled and qualified team who own all the right credentials to execute this job in a very proficient manner as per your exact requi Mais

€263 EUR in 5 dias
(2 Comentários)

Hi there, I have gone through your requirements and would say i can help you with [login to view URL] are professional web developers team having 6+ years experience in similar development. Please have a look my portfolio fo Mais

€205 EUR in 7 dias
(0 Comentários)

Scraping the data is no problem and running the PHP from cli is ok, but please inform me of which version of PHP you would prefer as some of the newer features will break on older versions. Can provide a normalized for Mais

€30 EUR in 7 dias
(0 Comentários)

Hello Ma’am/Sir, Greetings to you from Globussoft, We are the masters of Scraper development and have over 350+ scrapers in our product [login to view URL] can definitely make your scraper directory. We have made a lot of s Mais

€19 EUR in 7 dias
(0 Comentários)