Concluído

Web scarping and database set up

Hello,

My name is Silvia and I'm a researcher and I'm looking to collect some data from the [login to view URL] website. It's basically a web scraping project but I would also like to have an accessible dataset to work with if the data cannot be extracted in a usable format. I need to extract multiple information from the website, but it is often the same information on a loop.

More specifically, I would like to access information about the results of the Championship Tour (CT) competitions of men and women in the last 6 years (2014-2019). Additionally, I would like to collect data on the athletes performances and rankings but this is more straightforward.

After the web scraping, if the data is in a usable format (i.e all the information comes from few datasets and the datasets could be extracted directly from the website) then that would be the end of the project. However, if the data extracted is not easy to use, then I would like to have it as a sort of database in excel (here attached). It should be similar to this (this is just a proposition) but it could change if there is an easier way to write the database.

If the data is not in a user-friendly format, I would like to have a database as the one here attached. As an example, I have filled up the information of Heat 1, Round 1 of the 2019 Men Quiksilver Pro Gold Coast. The broader indications on where to find the data that need extracting is found here below (this is just one loop of course):

Athlete's ranking information:

1. Go to [login to view URL]

2. Click on the top menu: Rankings

3. Choose: Men’s Championship Tour (THIS IS WHAT I NEED per year) (I also need all for Women’s championship tour in the last 6 years)

Competition results:

1. Go to [login to view URL]

2. Click on the top menu: Events

3. Choose: Men’s Championship Tour (I also need all the competitions for Women’s championship tour in the last 6 years)

4. Click: Quicksilver Pro Gold Coast (I need this for all the events as well)

5. Click underneath the picture, in the middle: Results

6. Click: Seeding round (I need this for all rounds of the event)

7. Go to Heat 1 and click: View details (I need this for all heats)

8. Choose: a. Heat details (THIS IS WHAT I NEED, ALL the information)

b. Career events stats (THIS IS WHAT I NEED but I only need it once per event, this doesn't change per year so I just need it once per athlete per event).

Then we need this for multiple years so we have to re-do:

1. Go to [login to view URL]

2. Click on the top menu: Events

3. Choose: Men’s Championship Tour (I also need all for Women’s championship tour)

4. Go to the year 2019: Change to 2018.

5. Repeat all process again from step (4) above.

6. Re-do all the process again for the last six years.

Thanks everybody! If you have any questions let me know.

Habilidades: Captura de dados na web, PHP, Extração de Dados, Processamento de Dados, Excel

Veja mais: best database for web scraping, extract data from website to sql server, web scraping into sql, web scraping into database, how to store scraped data into database, scrapy, web scraping tutorial, python web scraping to database, web forms database php, upload data web page database, web template database entry sql server, free php web templates database sql hosting nuke, web programmer database, web designing database electronics flash photoshop, web driven database quote, convert static web site database, web interface database application, web design database photoshop, web albums database iis, populate web page database php mysql

Acerca do Empregador:
( 0 comentários ) Fremantle, Australia

ID do Projeto: #22261511

Concedido a:

mananraja

hey Silvia, I can make you the database in EXCEL ACCESS or any other platform you want. I have reviewed the excel file template you attached. I have checked the website you described, I can SCRAPE data from this websit Mais

$250 USD em 2 dias
(177 Comentários)
6.5

47 freelancers estão ofertando em média $421 para esse trabalho

seaanddream

Hi, my name is Selim. I am from Solihull, UK. I read your `Web scarping and database set up` project descriptions carefully before bidding. I checked the target url, and attached template as well... I got what you need Mais

$500 USD in 10 dias
(388 Comentários)
8.2
asin1987

Dear Employer, Thanks for clearing it so well, I will do your job for sure. I have checked your attached file as well. Please give me this opportunity. Will give data as well the scraping tool. Please check my previo Mais

$350 USD in 3 dias
(219 Comentários)
7.8
mirniyazuddin92

Dear Sir/Ma'am, I am a Web research, Data Entry & Web Scrapping expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can collect some data from the worldsurf Mais

$300 USD in 5 dias
(422 Comentários)
8.0
suhelshaikh

****6 Years of WEB Scrapping with DATABASE MANAGEMENT Expert**** I am interested to extract data I am a 6 -Years expert of Scraping or Crawling of any kind of website or directory having data in repeating sequence(Li Mais

$500 USD in 7 dias
(65 Comentários)
7.6
zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Mais

$395 USD in 4 dias
(171 Comentários)
7.7
sohandas

yes checked the excel file, do you want the data into different tabs? i can make a script (scraper)for you and you can reuse in future, can you please message me i have few question.............................thanks.

$350 USD in 3 dias
(315 Comentários)
7.5
idragon712

Hi, my name is Yanying Ding. I am from China. I read your `project name` project descriptions carefully before bidding. I checked the target URLs, and your requirements as well... I got what you need and ready to go Mais

$500 USD in 7 dias
(71 Comentários)
7.6
gangabass

First of all thank you for an excellent description! I can provide you a complete result in less than 24 hours. You'll receive Excel output + a web scraping script that you can use later for the same site. Thanks. R Mais

$250 USD em 1 dia
(548 Comentários)
7.6
etuannv

Hi there, I am interested in your project. I would approach your project by making a program to collect the data automatically. The program will be written in Python. The data will be stored in a mysql db. I have 4+ ye Mais

$500 USD in 7 dias
(94 Comentários)
6.7
Mickelson

Hi Nice to meet you. I have enough experience in python script. Below the libraries are I used in past project. selenium, pandas, matplotlib, lxml, beautifulsoup, scipy, and other useful libraries. I have written some Mais

$500 USD in 7 dias
(120 Comentários)
6.9
nekhbet

Hi Silvia, If you still need help please lets have a chat. Thanks Sorin

$500 USD in 7 dias
(237 Comentários)
6.9
khushh07

Hi, I understand your requirement and can do the job well.I am professional web scraper. I can complete your web scraping requirement on time with good quality results using Python scripting. I start script right away Mais

$500 USD in 7 dias
(277 Comentários)
7.1
Alexod

HI, I can build a quick DEMO app, just a demonstration, which will extract and structure all the information you need. Just contact me and I will demonstrate my skills

$250 USD in 7 dias
(1719 Comentários)
6.8
masterlancer999

Dear sir I am very interested in your project, because I have rich experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and Mais

$500 USD in 7 dias
(46 Comentários)
6.9
dvcontact

Hi, Would you like to see a quick sample list of your project on scraping the information about the results of the Championship Tour (CT) competition for male and female categories for the last 6 years and converting t Mais

$500 USD in 7 dias
(55 Comentários)
6.5
sauravkumar120

Hello their, I have just read your project details and I have seen its something i.e lot of data entry project completed in given [login to view URL] I can easily do, Kindly award me this project and I would deliver quality Mais

$250 USD in 7 dias
(126 Comentários)
6.7
expertserv

Hello Sir, I have gone through all your required instructions and and understood what you need to get done. I will perform an accurate web search to collect the required contact details from your provided link and in Mais

$250 USD in 3 dias
(109 Comentários)
6.5
mtdevil369

Hi, I have understand the project requirement & interested to work for this project. I will complete it by time. Please send a message so we can discuss more & start the project. Thanks.

$250 USD em 1 dia
(160 Comentários)
6.2
adicoman

Hi, I am very interested to work on your project. I have 17+ years experience in Web Development using a large variety of programming languages, frameworks, database architecture, APIs, CRMs, ERPs, mobile development Mais

$750 USD in 27 dias
(58 Comentários)
5.8
ckyeu

This is a very simple task and I can get started immediately. I have over 5 years experience on automation and web scraping. With your permission, I could get started immediately and show you results in a few hours. I Mais

$250 USD in 2 dias
(43 Comentários)
5.9