I need an experienced developer that can write an application that has crawler type of functionality that will do the following things:
1. Have the crawler go to the specified website every day at the time that I specify – login with the username & password that I will also specify (I should be able to type in this information into the application’s interface).
2. Then the crawler should download the daily five .csv files and one monthly .csv file that contains various user type of information into a folder that the application should automatically create on the local hard drive.
3. Once these files are downloaded then your code should parse these files and extract the first name, last name, and email address. Keep in mind that each one of these .csv files could have its own unique format when it comes to storing this information.
4. And once your application has parsed these files and retrieved the first name, last name and email address then your application should automatically insert this data into a database that I will provide for you.
5. Then I want this application to automatically launch a webpage and allow the code to run within the background so that I don’t see it on my computer screen. Now, this webpage has already been coded – so you won’t have to do any of this code. All your application needs to do is to automatically launch and allow this page and execute it until I stop it (or until the download process starts once again). Of course the application’s interface should allow me to enter this page’s URL that should be automatically executed in the background.
Well, that's pretty much it as far as functionality goes - but, I would also like to mention that I do want this application to be written as a client server application that can be minimized to the system tray where everything could automatically run in the background without any intervention from me. In addition, should you do a good job on this project, then I'll give you the opportunity to get additional work from me...
So, if you're an experienced developer that can do this type of work as specified above, then please place your bid. But, please be sure to tell me what kind of previous experience you have that qualifies you to do this project.
P.S. I'm on a strict timeline with this project and I urgently need this project to be completed right away - so, if you're available to start right away, then please let me know as prority will be given to those developers that can start and finish this project in the next couple of days...
4 freelancers are bidding on average $79 for this job
I have done many crawlers in my latest search engine [url removed, login to view] i have lot more Experience in that.I can do you [url removed, login to view] check PM!!