Build link checker website crawler

We are looking for an experienced coder to create a web site link checker and crawler.

This program should be able to do the following:

1. Crawl all pages on a site

2. Collect the title tag and meta description on each page

3. Keep track of how many outgoing links each page has, and how many incoming links each page has

4. Keep record of all internal anchor text links (text and where that text links to). For example "home builder san diego" links to [[url removed, login to view]][1]. This should be a separte report that shows ONLY anchor text links (not image or other links)

This program should be able to export this data to an excel spreadsheet.

It should have multiple threads to make it fast.

For a good comparison program you can look at the website below (remove the C's). It does everything we want except for displaying the meta description, and anchor text links. It does a lot of things that we don't need as well. We only need pages, not images or anything else.

example software

[url removed, login to view]**lCiCnCkC**.html

Habilidades: Engenharia, Microsoft, MySQL, PHP, Gestão de projetos, Arquitetura de software, Teste de Software, Área de trabalho do Windows

Veja mais: report builder excel, report builder 11, html spreadsheet example, how to build a good website, excel spreadsheet builder, how to create a web crawler, how to build a web crawler, build things, website crawler, link on website, html checker, data crawler, crawler, crawl a website, web data crawler, php checker, crawler description meta, crawler report, fast crawler, php crawl web link, php crawl web, link build website, php collect data website, create san, create report excel spreadsheet

Acerca do Empregador:
( 123 comentários ) United States

ID do Projeto: #2956412

Concedido a:


See private message.

$637.5 USD em 16 dias
(55 Comentários)