Encerrado

Automization for reading table in an remote excel file from public ftp and storing data to mysql

Please send me a relevant project you have completed with the bids.. thank you. You can find each detail below:

Project is shortly finding, reading and transferring data from remote excel file available publicly in FTP. This excel file is stored in a public FTP and updated daily and the data cell sturcture of the excel file is always same. All excel files are systematicly updated and same.

REQUIRED STEPS FOR SOFTWARE:

1- Search for daily updated excel file in a public ftp.

2- Transfer excel file to our server.

3- Read data from excel file (for example: 15 variable cells needs to be read) from the table inside the excel file.

4- Store the data from exel files to mysql database.

5- Create javascript line time series charts from the data stored in mysql.

DETAILS OF THE STEPS:

1- FIND THE EXCEL FİLE: There are excel files in a public remote ftp. These files are updated daily in weekdays. Software will search the public FTP for the updated excel file. Updated are data are stored into new excel files each day. The name of the excel files follows a systematic date/month/year pattern according to the day's date. The files are only updated in weekdays, therefore, the software should only do the search in the weekdays. For the weekend files, software should search these in every Mondays. The daily excel files of the weekends are updated in Mondays again with the relevenant day files seperately.

Instead of searching every day, software should do some logic for weekend files. There is an additional thing on this, the public days. Public days data are also not being updated in public days and these also updated in the following workday. Therefore, software should have more logic on searching daily files.

--

I think that to solve this software can search excel files of last 10 days every time (some public holidays takes longer) and should check If that files already transferred or not to our server that way I think we can make sure that we got every file.

--

As defined above, the files are updated daily. There is no spesific time for the update, It could be 9:00 in the monring or 14:00 in the afternoon in workhours. Therefore, the software should constantly search for the last missing daily excel file in every 5 minutes. I guess this can be achived by a cron job.

2-TRANSFER EXCEL FILE Excel file will be transferred to our server ftp.

3- READ DATA FROM CELLS: The data inside the excel file is needed. The tables in the excel files are always updated into same cells, table is always same cell structure, only the variables inside the data tables are updated for each day seperately.

There is only one issue with the data cells inside the excel file: Data table inside the sheet is always same but sometimes the data table itself moves one cell right or left. This happens very rarely but happens and which could prevent reading the data completely. I mean software can't be programmed to read from cell B3 for example.

I guess this can be solved by finding the first top left cell and by checking If there is a data considering rest of the cells has no data. Thay way, the table will be determined correctly because table structure is always same pattern.

4- STORE TO MYSQL: We need this data stored in mysql database. As you can understand, there are variables for each days which means there is times series. Therefore, we need to store the data with day unique id's and variable names on the columns.

I will inform additionaly regarding the table structure.

5- CREATE A JS CHART: Now, we have the data in our server. We need to see trends by line charts for example in this time series data. This is the last ste, therefore, I will explain what we need after we complete the previous 4 steps.

Please find attached the exce data table which needs to be read.

As you can understand, most importing thing in this project is reading excel files timely and storing this to mysql correctly as a datatable.

Habilidades: Excel, Javascript, MySQL, PHP, Arquitetura de software

Ver mais: workday architecture, what is searching in data structure, what is data structure in c, what is data structure, what is data in data structure, what is a data structure in c, what is a data structure explain, what is a data structure, what do you mean by data structure, what data structure, what are data structure, weekend update, weekend job search, tables in data structure, table data structure, searching in data structure, searching data structure, search data structure, remote excel, pattern searching, new data structure, need of data structure, got transferred, find the right job for me, finding the right job

Acerca do Empregador:
( 5 comentários ) new york, Turkey

ID do Projeto: #6824663

21 freelancers estão ofertando em média $648 para este trabalho

rinsadsl

Hi Good Day I have done more than 600 projects here in [url removed, login to view] only. I have worked in all the scenarios you have listed as connecting to remote server using ftp, transferring files, processing excel sheet and Mais

$368 USD in 7 dias
(474 Comentários)
7.7
Reflexlogic

Hello, I have reviewed your requirement & understand that you want to build a website that will read excel files from public ftp server. We will build a cron that will check files every 5 minutes & will fetch las Mais

$750 USD in 10 dias
(82 Comentários)
7.3
AcuityInfotech

Hi,    We’ve had a good look at your project description and we’re very interested in providing a solution. We have done sort of smiler kind of solution earlier where we are allowing to upload the XLS file to comp Mais

$555 USD in 10 dias
(38 Comentários)
6.8
stevecorsi

Hi, It\'s Steve.. If you are available right now I would like to show you one of my previous work that grabs excel files (excel directly or zip file containing excel file both) and puts it on our server and then parses Mais

$944 USD in 7 dias
(38 Comentários)
6.1
dpune

Hi, I have more than 14 years of exp and I am expert in this kind of work. I have completed more than 220 projects. Please look at the feedback left by my employers to know more about my work. Waiting for your positive Mais

$750 USD in 30 dias
(80 Comentários)
5.8
winnet21

Dear friend , I have experience with this project, please reference 02 small examples that I done here: export data from Ms Access to csv file and tranfer file to server through ftp protocal: [url removed, login to view] Mais

$500 USD in 20 dias
(28 Comentários)
5.6
gkws

Hello, Greetings from geniuskline webtech solutions pvt ltd. Following are our past work, have a look. [url removed, login to view] [url removed, login to view] [url removed, login to view] [url removed, login to view] ht Mais

$670 USD in 15 dias
(21 Comentários)
5.5
johnflash

Hi, i see you need a script which would fetch excel files regularly, transfer them to your server, then import the data into mysql providing a front end where the data appears as a line graph. I can get this done fo Mais

$500 USD in 5 dias
(11 Comentários)
5.4
anuyadav1

i can write this script .

$380 USD in 3 dias
(33 Comentários)
5.4
freshjah

I currently do not have a ready sample for your review. however I have extensive knowledge in PHP and MySQL to complete this job to your specifications.

$722 USD in 7 dias
(25 Comentários)
4.9
thanhhungqb

Dear sir, I have read your requirement and excel attached file carefully. I have experience on domain of your project include: fpt file check and get, php, mysql and also real-time show result with js chart. I think Mais

$300 USD in 5 dias
(54 Comentários)
4.9
anshangtai

Dear Sir. I see you wish to complete PHP/MySQL job to update database automatically using excel file. I have good technical experience in completing such jobs. I have successfully delivered such a job from a Mais

$605 USD in 10 dias
(10 Comentários)
4.8
lavizsolutions

Hi, I have gone though the description carefully. for reading xls files . daily excel files are uploaded on server with datetime stamping. As we do it first time lets say it have 10 files in ftp, so as our app Mais

$789 USD in 15 dias
(3 Comentários)
4.7
LuckyCharmsSoft

A proposal has not yet been provided

$526 USD in 10 dias
(7 Comentários)
4.6
phamtech211

Dear Sir/ Madam, My name is Henry from PHAMTECH Co. My team is fascinated in this project as it is exactly within our scope of expertise: We are an 8-year experienced web/ app design and production group. We are Mais

$1888 USD in 30 dias
(8 Comentários)
4.5
binarycodersvw

Hi.I have read the description of your project and I am [url removed, login to view] name is Andrei. I am a Visual Basic .NET programmer and website developer with 10 years experience. I know you hear things like these a lot but I ca Mais

$1234 USD in 17 dias
(10 Comentários)
4.4
kkokko555

Hello I am a full-time freelancer who has rich experience and high skills in PHP / MySQL / Javascript / ajax / jQuery / ... programming. I am sure that i can complete your project successfully. No problem. Can we Mais

$315 USD in 7 dias
(10 Comentários)
4.1
synanisthehero

hi. i am a php developer. this is one of my last projects about saving data on excel file. [url removed, login to view] i worked with high charts many times. i can finish you Mais

$350 USD in 5 dias
(18 Comentários)
3.4
avasp

Hello, I have 14 years of experience in software development with strong technical background. I have strong development experience in Java, J2EE , C++,C#, data structure, algorithm, design pattern, Object Oriented Mais

$288 USD in 15 dias
(4 Comentários)
3.0
abagunjal

we will develop a nice enterprise level application using open source softwares like apache camel, tomcat , database mysql and java. The camel is tool for integration purpose and rules can be implemented easily. specif Mais

$778 USD in 10 dias
(1 Comentário)
2.2