I simply need all of the outbound links from a single website in a text file.
You will need to have a spider that complies with [url removed, login to view] and that can be run nicely (no hammering of the target server). I just want it to extract any outbound link that is found and give me a text file with all of those links. There will be about 10,000 pages to crawl.
I'm not looking for the spider program itself - I just want the deliverable - a text file with the outbound links.
1) A text file with all outbound links found.
2) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).