online and distributed link checker

Some links to different websites and offline tools who support what I need: - [login to view URL] - [login to view URL] - [login to view URL] - [login to view URL] Link Checker and Website Analyzer Need to analyze an entire website recursivly for errors and possible improvements. Key functionionality is: Link Checker and HTML Validator • HTML and CSS validate • Have link checker tool find and show broken links and broken redirects. • Analyze file sizes, response codes, download times etc. of all pages. • Optimize internal linking to focus link juice on pages you want indexed. • Analyze entire website to find website and crawler problems. • Fix link juice flow, broken links, file sizes, CSS and HTML errors etc. • Broken links: Link analysis and validation ensures your website has no broken links. • HTML errors: HTML validator ensures pages are crawled and shown correctly. • CSS errors: CSS validator ensures visual elements render correctly in browsers. • Response time: Can the webserver respond to multiple concurrent requests? • Download time: Is the webserver CPU or bandwidth too slow at serving files? • Character set: If a page outputs this wrong, it can hinder indexing by search engines. • File size: Optimize bandwidth usage and download time caused by large pages and images. • PageRank sculpting: Analyze how internal link juice flows to important pages you need to rank high. • Page titles: Check if all page titles are optimized and none are duplicated. • META description: Verify page META description and keywords are relevant with no duplicates. • Custom search: Search and check all pages for custom text and code, e.g. Google Analytics. • Spell check: Check websites for spelling errors using a variety of spell checker dictionaries. • Analyze links. • Spell check. • export reports to CSV and use them from any spreadsheet software The expectation is that there is a central website and a tool which can be installed on multipe machines which are receiving jobs from the central system, running all the neccessary work from a distributed node and update afterwards the central system with the results. All interacations need to be developed with XML & JSON and interfaces need be provided.