Web Scrapper Data Management System

Concluído Postado Jul 24, 2013 Pago na entrega
Concluído Pago na entrega

We have legacy PC software which requires the ability to access sports data for several different types of sports popular in the US. Our existing system for compiling sports data and putting it into the format used by our legacy software is due for replacement and that is what this job posting is about.

We intend to create a new Sports Data Management System in two phases.

This project is about the first phase and will include an abstract class for scraping sports data from web sites, and an actual implementation of the abstract class for American football.

Once the data has been scraped, additional processing will be required:

First, players and teams will need to be looked up in an existing legacy database in order to obtain their legacy ID number. Heuristic searches based on simple pattern recognition will be required as the names may not always match exactly. Exception processing is required if a player or team can not be matched, and this will be detailed in our specification document.

Once the data has been scraped and the legacy ID number has been found (or exception processing taken place), then a set of CSV files will be generated based on templates provided in a configuration file for the system. A straightforward template which specifies a sequence of tags used by the scraper will be used to specify the contents to be included in each CSV file and the order in which they are to be placed.

The above concludes what we need for Phase 1 of the project. The second phase will be listed as a new project under oDesk and will be preferentially offered to whomever completes Phase 1 to our satisfaction. It will consist of building a Django-based GUI around the system constructed in Phase 1 with a specific set of features which we will detail before the project begins.

We require the system to be developed in Python. With regard to the scraper, our only requirement is that it use a scraping library based on XML tags. The Python code should follow the PEP 8 Style Guide (see [url removed, login to view]) and should be self-documenting using Python docstrings.

Please note the deadline for this project. We have schedules imposed on us by external factors and you should not expect that we will be able to extend the schedule any further, so place do not apply if you aren't confident you can meet the schedule.

We require applicants to be fluent in English and available to have regular meetings with use via Skype (audio).

Given our tight schedule, we are looking for a full-time developer with plenty of relevant professional experience for this job. We reward hard-working and productive individuals with quick payments, positive feedback, and exclusive offers for future work. We do not tolerate poor performance, missed deadlines, or excuses designed to justify the same.

Please ignore the budget for this project and bid whatever you would like to be paid for it.

MySQL Python SQL Captura de dados na web

ID do Projeto: #4759407

Sobre o projeto

9 propostas Projeto remoto Ativo em Aug 1, 2013

Concedido a:

sayno2bugs

Highly experienced in writing web scrapers. Please check my bid to know more. Cheers, SayNo2Bugs

$833 USD em 10 dias
(17 Comentários)
6.1

9 freelancers estão ofertando em média $609 nesse trabalho

phpXpertbd

Seasoned web scraper. I worked on many similar projects, I have big experience in data mining projects. I can finish this task in short time, with the best quality.

$555 USD in 3 dias
(19 Comentários)
5.9
appollosputnik

I am an expert Pythpn MySQL developer please review my bid i can do your project. Let me know when you plan to start the work with me. Thanks Sujan

$555 USD in 25 dias
(2 Comentários)
4.7
vinsoneric

Hi, I can work on this. I am expert in web scraping. Thanks

$277 USD in 3 dias
(7 Comentários)
3.8
miniric3

Kia ora! mulvays are a NZ based web and software design company who have seen you here on the freelance market and are really excited about working with you and treating you to the full service, professional experience Mais

$773 USD in 21 dias
(2 Comentários)
4.4
KnightLight

Expert scrawler.

$444 USD in 20 dias
(1 Comentário)
2.6
omanasoft

I offer to provide the software that meets your needs. It will be a solution in Java, built on top of my own already developed, demonstrable web-scraper tool. The web-scraper tool is designed for complex web-scraping, Mais

$833 USD in 3 dias
(0 Comentários)
0.0
NTechcorporate

Hi, We have expert in-house team of Python programmers. Please check private message.

$541 USD in 21 dias
(0 Comentários)
0.0
machinist

I have done similar projects and would enjoy doing this for you.

$666 USD in 6 dias
(0 Comentários)
0.0