We want to collect data (prices, product availability, product information, digital assets) from our suppliers from various sources (FTP, URL) and combine them in a master table.
Access to the data is protected with a user name and password.
The mapping is specified by us and does not have to adapt to the source or be editable by the user. Basic function only, no luxury (maybe in a second version).
The data are available in various formats (XML, CSV) and can also be compressed in individual cases (ZIP).
The data must be called up periodically (usually every hour or every day).
The data serve as the basis for automated quotation creation for our online store.
We have the vision. Not the solution. Be Our Expert. Which solution is suitable and does not cause horrendous monthly costs?
16 freelancers estão ofertando em média $22/hora nesse trabalho
I am a professional data engineer working in the field. I would be the best person to handle the scenario, furthermore, I can help you in infrastructure setup and educating your resources.
I have experience in setting up ETL scripts for regular table maintenance in DWH, scheduling scripts to upload data to DWH from third party platform. I have skills and experience to work on this project.
I have expertise of data warehousing and have build data marts using pentaho /[login to view URL] I’m your requirement I can choose any of these application to cater to your requirement.
Hope this message finds you well! I have been working as an ETL developer and this looks like a good challenge. I would love to be considered for this. The bid is negotiable.