I am currently in the process of setting up a website and therefore need someone to develop me a bot/crawler to look for articles on X amount of websites and re-post them on my site.
I want it not having any dependencies (so not bound to WordPress/Joomla or anything) at all and want it to work for most of the websites/genre/language etc.
- The bot should be able to automatically import articles from other websites with a specific genre, summarize the article in X amount of words and at the end add something in the lines of: "quoted from [url removed, login to view]"
- For the above, there are applications such as HTC Blinkfeed which uses some sort of algorithm to summarize articles without losing any valuable information, I want an algorithm just like that, if possible.
If possible, I want it coded in OOP so I could simply integrate this bot with any database and/or app as I wish. The bot should be easy to maintain with a solid interface and modified to my exact needs.