Keywords: Harvesting crawler, data mining, extract data, web scraping.
This project is to write a web based program that will crawl several websites during a specific timeframe each day and extract stock ticker symbols based on certain keywords.
Program will then take these ticker symbols and check to see if these stocks have started to go up and down in price by checking a realtime stock price and then post / insert the stocks that have moved in a particular direction into a table on our website (in a members only area).
It should automatically archive the stocks in the website day by day. We should be able to view the stocks for each day. Stocks will be archived indefinitely.
Your choice of programming language. Must be able to run on Linux web server. Future projects available upon satisfactory completion.