Web Grabber

Web Grabber Requirements

We need a windows program that does the following.

We have a database with 20,000 minimum web url's of specific company’s. The program has to crawl through the websites and grab all text content in the sites and bring me the following data in a mdb file.

The data it should grab are:

(A rough idea about the data structure of the database)


Base url (the url that was originally given to grab)

Email addresses found

Tel numbers found

Fax numbers found

Url where the data was found

All text found in the url separated by a space

I need to be able to add extra addresses with url's

The grabber has to go in an automation mode and be able to run continuous and also the data in the mdb file has to be updated like every half hour. Off course the grabbing has to be done on multiple threads so the time to get all information will be as fast as possible. It should recogize blackholes.

The whole program will be in a client-server architecture. Please read the associated file for more details.

Habilidades: .NET, Visual Basic, Área de trabalho do Windows

Veja mais: web go, visual web, that web company, please tel me, go web server, go web go, fast web, details about space, data structure through c, basic of data structure, about data structure, web fax, web program, web net, threads, rough, multiple course, mdb, it web, it base company, grabbing, crawl a we, continuous, basic server web server, net crawl

Acerca do Empregador:
( 0 comentários ) Kolkata, India

ID do Projeto: #24829

17 freelancers estão ofertando em média $243 para esse trabalho


We will doing all that you want (and more... :-))). Quickly, Professional, Quality - our answer you and your organization. We work more than 10 years.. There are questions?

$300 USD in 10 dias
(2 Comentários)

6+ years experience in software development

$250 USD in 15 dias
(7 Comentários)

hi, i have read your requirement and i am confident to deliver to you the result within the time. Looking forward to work with you on this project. Thank you

$150 USD in 7 dias
(16 Comentários)

Chandusoft is a customer-specific service oriented company has got an Professional and creative team with 6 years experience in Web design , web programming and software development . We have expertise and experience Mais

$240 USD in 15 dias
(3 Comentários)

pl see pmb for details

$300 USD in 26 dias
(1 Comentário)

I have 7 Years Experience in Web Development and Software Development and i am ready for this project. I have done previously many projects of data extraction.

$250 USD in 15 dias
(6 Comentários)

We are a group of highly educated professionals with specialization in various fields. although we are new to [url removed, login to view], we have done such projects before and we are confident of doing your project. We will always be Mais

$230 USD in 15 dias
(1 Comentário)

will give you the best solution

$250 USD in 15 dias
(0 Comentários)

We already have some Http grabber. Moust of the wanted feauters are already implemented. THe in/output have to be castomized for your needs, and a client/server structire have to be estimated.

$250 USD in 20 dias
(0 Comentários)

Dear Buyer, Thank you for reviewing my bid. The bid amount & completion period is based on the information of the project provided here. The completion period may vary if the inputs are delayed by the client. The bid a Mais

$230 USD in 20 dias
(0 Comentários)

Please see [url removed, login to view] --> on the front page, the news content is grabbed daily by a similar app to what you require. This page is refreshed based on the content of 2 news site. In the access protected areas there ar Mais

$300 USD in 10 dias
(0 Comentários)

Hello!! We have gone through the project information and we are very much interested in working and having a long term relationship with you. We can meet your requirements. We have good and talented team of Desig Mais

$290 USD in 7 dias
(0 Comentários)

Dear Sir/Madam, You can visit the sites made by us, [url removed, login to view], [url removed, login to view], [url removed, login to view], www.mediainfonet.net. These will give you some ideas. We can give you improved Mais

$210 USD in 12 dias
(0 Comentários)

Please see PMB and let us start a new business relation.

$300 USD em 1 dia
(0 Comentários)

Respected sir/Mdm, our team has developed a similar project before this. It used to grab text and images(ccording to Customization) from complete web site or seperate web pages. So we are the best option you are havin Mais

$230 USD in 15 dias
(0 Comentários)

I can do. Please take a look on this samples and let me know: [url removed, login to view] . I'm ready to start when you are. Thanks, Sorin

$100 USD in 6 dias
(0 Comentários)

Please See PMB.

$250 USD in 25 dias
(0 Comentários)