Concluído

Database Management System and Python Website Scraper

I need a web based application to perform the following:

Database Management

- View database records and related photos on a multi-million record database

- Store and manage photos associated with database records

- Search database records based on various database fields/taxonomies

- Interface with Python website scraping script (to be built by you - details below)

- Allow database record update via scraping individual website pages/records

- Capable of running on shared host/VPS/Bare metal server

- Database management capable of creating new tables/records based on existing database records.

- Has full CRUD capabilities

- Database needs an secure API for entering CRUD operations

Admins: Can edit database records

Users: Can search database records and mark them as requiring update

Webscraping Script

- Coded in Python

- Multi-threaded

- Scrape individual website pages and multiple pages

- Scrape associated photos on individual pages, label with custom name

- Store results in database

- Have basic error handling capabilities

- Data logging errors during scraping

- Proxy management

Will need to have a discussion regarding what database to use.

Habilidades: PHP, Python, Captura de dados na web, MySQL

Sobre o Cliente:
( 16 comentários ) Portsmouth, United States

ID do Projeto: #34321220

Concedido a:

sapnathakur14

Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP, Python are my major, so you Mais

$1300 USD em 7 dias
(134 Comentários)
8.0

93 freelancers estão ofertando em média $1219 nesse trabalho

r4rony

Hi Have a Blessed Day! I just read your job posting brief that you are a searching for an expert to assist you with making appealing and interactive website. So as we don’t have exact requirement of your project. So Mais

$1125 USD in 35 dias
(216 Comentários)
9.1
(431 Comentários)
8.5
(197 Comentários)
8.1
AzzkaNoor

Hello. Experienced Python Web Scrapper here with 9+ years of hands-on experience in python web scraping and Database Management System. I am happy to mention that I rank in the top 2% among 58+ million freelancers. I a Mais

$1500 USD in 30 dias
(71 Comentários)
8.3
chirgeo

Hi. Can you let me know the website you need to get data from? What I suggest is that we can setup a directus CMS fort you where you will see data and be able todo the managemnet, is that OK?

$1500 USD in 7 dias
(150 Comentários)
7.8
(148 Comentários)
7.9
AwaisChaudhry

Hi there! I have read what you exactly need and I have great experience with MySQL, PHP, Web Scraping and Python. However I would like to ask you a few questions. I do work smart and do not rest until I get the job don Mais

$1500 USD in 13 dias
(52 Comentários)
7.5
(71 Comentários)
7.4
(334 Comentários)
7.9
(385 Comentários)
7.3
(146 Comentários)
7.2
(187 Comentários)
7.3
(37 Comentários)
7.0
(103 Comentários)
7.1
mmadi

Dear Daniel M., As you can see my review, I'm expert in MySQL, PHP, Python, Web Scraping So no worry about completing task Let's discuss in detail and start right now I can do this within your budget too $750 - $ Mais

$1200 USD in 24 dias
(50 Comentários)
7.1
(58 Comentários)
7.1
(148 Comentários)
6.7
(32 Comentários)
6.8
saubhagyamweb

Hello Mate, I am pretty sure I can produce high-quality and perfect results for your project. I do have the necessary skill set & resources to complete this project. I’m a Professional and Expert Software Developer ha Mais

$1125 USD in 7 dias
(55 Comentários)
7.1
(221 Comentários)
7.1