I have posted this project one but didn't realise that it wasn't available for anyone to bid so am putting it up again for a short period to make it available for everybody. I have 2000 csv files with around 300,000 to a million lines of data in each. These relate to horse racing markets to a second refresh rates. I need to be able to upload quickly and efficiently all of these files and then analyse them to get specific settings which will be described to the winning bidder. Although the software needs to be able to upload them all at once it must analyse them as individual races quickly and efficiently(there is race information to seperate them within the csv files). The winning bidder must be prepared to sign a non-disclosure agreement and there is the possibility of a lot more projects to work on. If you have any questions please don't hesitate to get in touch.