Encerrado

Spider That Downloads Content

I would like a script written in PHP for a linux server.

I will call it a site replicator for easy understanding.

I would like it to do the following:

- Be given a starting URL to start.

- Crawl every possible link it finds within this page and start downloading everything that it finds, and save what it finds,keeping the directory structure the same, on my server.

-I want to be able to specify the ammount of layers I would like it to crawl. (How deep the scan should go)

-I want to be able to exclude certain file types if neccesary

-I want it to get the html pages AND THE IMAGES FOUND ON THESE PAGES

- I want it to be able to follow dynamic URLS as well. If the pages are made from a CGI or php script then I want them to be able to be downloaded as well.

- bonus would be to have an option to stay only within this root URL, or allow it to go outside the given URL.

I want it to start on the starting URL and download everything it finds, and save it to my server.

Pretty simple right?

Habilidades: PHP

Ver mais: written content, neccesary, how to get cgi, stay, pretty, outside, layers, cgi images, linux php scan, call url script, save file directory, follow follow download, php call cgi, download follow follow, pretty url php, url crawl, script call url, link spider, directory content, php dynamic page content, save url file, simple crawl script, crawl content url php, content page, file scan

Acerca do Empregador:
( 0 comentários ) Riverside, United States

ID do Projeto: #23393

15 freelancers estão ofertando em média $219 para este trabalho

siddhartha1

would be pleased to offer you our services,regards

$300 USD in 15 dias
(35 Comentários)
7.6
cstl

[url removed, login to view] is a customer-specific service oriented company has got an Professional and creative team with 6 years experience in Web development, software development and data entry. We pay attention to every small Mais

$270 USD in 10 dias
(18 Comentários)
6.9
viaden

Dear Sir/Madam! We've gone through your description and are confident of meeting you requirements. Our company has been in the sphere of web development and programming for 10 years already, always providing its client Mais

$300 USD in 15 dias
(3 Comentários)
6.2
smirnoff

Have it ready made.

$220 USD in 2 dias
(14 Comentários)
5.6
izwan00

Please see PMB.

$100 USD in 0 dias
(20 Comentários)
5.2
nidle

Hello, We got extremely interested in the project proposed. We are an IT company specializing in web technologies and programming. Our specialists are ready to start working on the required script solution straight aw Mais

$300 USD in 20 dias
(2 Comentários)
4.9
Kaabi

Glad to work with you :)

$300 USD in 7 dias
(28 Comentários)
4.5
mediajohnny

Stealing content will land you in court buddy.

$100 USD em 1 dia
(2 Comentários)
3.9
bagilevi

I have done similar project before, and I can do everything you mentioned.

$100 USD em 1 dia
(4 Comentários)
3.4
Aure

Dear Sir, I have a one year experience with PHP technology. I can do this fast and honestly. I've been doing a project similar to yours and so the only thing to do is adjusting the script to your requirements. It shall Mais

$200 USD in 2 dias
(2 Comentários)
3.7
tanuj99

pl see pmb for details

$298 USD in 15 dias
(1 Comentário)
3.2
fictionwebs

Outsource Web Development, Website Design, Logo Design, Banner Design, Scripting and Programming, Flash Animations, Corporate Identity, E-Commerce Payment Gateway Integration === Serving since 7Years on the web, Fictio Mais

$250 USD in 5 dias
(0 Comentários)
0.0
kroniks

We will do this project quickly and quality. This sounds like a really interesting project. We would like very much to work on it. We believe "Quality is not an act, it is a habit". Payment escrowed to get me st Mais

$290 USD in 10 dias
(0 Comentários)
2.4
karols

We can provide secure and flexible solution, with well organized and commented source code which make future modifications very easy. We never sacrifice quality for short realization time. We prefer work to take a litt Mais

$150 USD in 5 dias
(0 Comentários)
0.0
Randeep

We are a group of highly educated professionals with specialization in various fields. although we are new to [url removed, login to view], we have done such projects before and we are confident of doing your project. We will always be Mais

$100 USD in 7 dias
(0 Comentários)
2.0