I need a web based application to perform the following:
- View database records and related photos on a multi-million record database
- Store and manage photos associated with database records
- Search database records based on various database fields/taxonomies
- Interface with Python website scraping script (to be built by you - details below)
- Allow database record update via scraping individual website pages/records
- Capable of running on shared host/VPS/Bare metal server
- Database management capable of creating new tables/records based on existing database records.
- Has full CRUD capabilities
- Database needs an secure API for entering CRUD operations
Admins: Can edit database records
Users: Can search database records and mark them as requiring update
- Coded in Python
- Scrape individual website pages and multiple pages
- Scrape associated photos on individual pages, label with custom name
- Store results in database
- Have basic error handling capabilities
- Data logging errors during scraping
- Proxy management
Will need to have a discussion regarding what database to use.
93 freelancers estão ofertando em média $1219 nesse trabalho
Hi. Can you let me know the website you need to get data from? What I suggest is that we can setup a directus CMS fort you where you will see data and be able todo the managemnet, is that OK?