Em Andamento

Pricing data upload

Hundreds of files with mostly the same structure need to be uploaded into a database. The database, consisting of two tables, is already created and contains data, but no recent data upload has taken place.

Both tables need to be populated from the following types of files:

1- csv files: about 700 exist, all with the same format

2- xls files: 6 of these exist, all with the same format

Data needs to be extracted from selected columns. The data needs to be inserted into two database tables: one for price data and one for static data. The date to which the data pertains needs to be added as well.

So the deliverables are:

1- the database export that should be created after loading of the latest set of files as well as the load script for re-insert

2- scripts that have been used to parse the csv-files

## Deliverables

We already have a script for just one file and the shell script is probably easily extensible for the date-appended files that we have.

The files are downloaded from the same site everyday and sometime in 2005 a new column was introduced, so that is the only change to the datastructure we are aware of. The lines in each file varies between 200 to 800 lines.

Both the price table and the static data table need to be populated from these files.

The difficulty lies in checking whether all data is complete, whether clearly erroneous prices are present, duplicate rows etc. So some common sense without much guidance from our side is highly preferable. You may have to do some manual data cleansing in a few files (<10), in case some corruption may have occurred.

Habilidades: MySQL, SQL

Ver mais: types of data structure, types of datastructure, types data structure, tables in data structure, table data structure, set in data structure, set data structure, sense checking, new pricing, new data structure, format pricing, data structure types, data structure set, data structure in, datastructure, about data structure, data cleansing, data checking, cleansing, duplicate table, shell script csv, rows insert, insert xls mysql table, csv column format, mysql inserted

Acerca do Empregador:
( 6 comentários ) London, Netherlands

ID do Projeto: #3048990

Premiar a:

AddisSoft

See private message.

$85 USD em 20 dias
(3 Avaliações)
2.7

18 freelancers estão ofertando em média $98 para este trabalho

MJCUBE

See private message.

$127.5 USD in 20 dias
(288 Comentários)
6.6
weng0000

See private message.

$127.5 USD in 20 dias
(684 Comentários)
6.6
tomkusvw

See private message.

$85 USD in 20 dias
(38 Comentários)
4.9
jkormyk

See private message.

$93.5 USD in 20 dias
(6 Comentários)
4.5
jpcentral

See private message.

$105.4 USD in 20 dias
(15 Comentários)
4.5
basrimy

See private message.

$127.5 USD in 20 dias
(10 Comentários)
3.5
eeuguru

See private message.

$120 USD in 20 dias
(3 Comentários)
2.7
klvworker

See private message.

$85 USD in 20 dias
(5 Comentários)
2.3
sibelakyigit

See private message.

$110.5 USD in 20 dias
(2 Comentários)
2.1
marekwaszkiewicz

See private message.

$85 USD in 20 dias
(7 Comentários)
1.0
lilacwine

See private message.

$85 USD in 20 dias
(4 Comentários)
0.7
colechristensen

See private message.

$85 USD in 20 dias
(1 Comentário)
0.0
nyambo

See private message.

$93.5 USD in 20 dias
(0 Comentários)
0.0
bampbsolution

See private message.

$85 USD in 20 dias
(0 Comentários)
0.0
code4passion

See private message.

$93.5 USD in 20 dias
(0 Comentários)
0.0
arpinca

See private message.

$85 USD in 20 dias
(0 Comentários)
0.0
XaCaHaa

See private message.

$85 USD in 20 dias
(0 Comentários)
0.0