Hi,
I'm an experienced ETL/Data Warehouse developer and I can offer you a solution based on Pentaho Kettle (a.k.a. PDI). It's an ETL (Extract, Transform, Load) tool that facilitate the processing of data. Here is a highlight of its most important features:
1. Extraction - PDI could extract data from any kind of
a. RDBMS system - Oracle, MySQL, PostgreSQL and many others.
b. NoSQL - Hadoop, MongoDB, CouchDB, Cassandra and others.
c. Files - CSV, XML, Excel, JSON and many others.
d. Web Services/RSS Feeds and many other data sources.
2. Transformation - PDI has large number of built-in steps for data processing: filtering, sorting, aggregation,
lookups, additional calculations, etc.
3. Load - PDI could export the processed data into many different formats or it could load it into a relational/non-
relational database management system.
It's important to note that Pentaho Kettle is FREE and open source software (OSS), so it's very easy to extend it with custom plugins. Moreover, its UI is very intuitive, which makes the implementation/building/deployment/maintenance of the code a lot easier than any bash/python/java/C# solution you would come with.
If you need more details about Pentaho Kettle, feel free to contact me.
(I could give you a quote for the price, when I get more info about the job and the scope.)
Best Regards,
Vesselin Z.