I need to extract meta tag details from any url/site/directory, filter that information based on certain criteria to end up with a clean list in CSV format ready for me to use. I need a simple windows application to let me do it.
See videos for more information [url removed, login to view] and [url removed, login to view] and [url removed, login to view]
( be sure to watch these above )
Needs to be able to
[url removed, login to view] it any type of url and any site ( i.e page or directory ) ( which to make a note it should be able to work with yahoo answers category directory )
[url removed, login to view] in the pages - So many levels deep I can select, all within current directory or all within current site
[url removed, login to view] Options - Lets me take the list of meta tags and filter them using 1 or several of these
[url removed, login to view]
[url removed, login to view] anything that doesnt start with: Who, Where, When, What, Why, Could, Should, How
C. Remove any that dont have the symbol ? at the end
D. Strip out from any meta tag Anything after the symbols - or : or |
E. Strip out from any meta tag anything before the symbols - or : or |
[url removed, login to view] me to save the end result ( filtered ) to csv file. So when its viewed all the meta tags are in 1 column, huge list.
5. Allow me to MINE for new meta tags by letting me Save project based on urls brought in, and then continue project say days, weeks later and have it only display the latest additions to that
list ( maybe on a different tab or different color some way of letting me see which are the new ones vs the old ones i brought in, then lets me save the new ones to a new csv )
A. Each time i use the app it should let me either Create project ( give a name ), save project, open an existing project,
B While using the app it should let me stop, or continue.
When it gets the information from sites it needs to do it as though it was just a person surfing to not alert site to anything strange. There should be intervals between each grab which i can determine as shown in the video
My budget for this is not high, I will probably go with whoever can provide the most affordable option