Encerrado

PHP Downloader

I want:

1. a script which I will host on my server

2. to download a lists of dynamic webpages

3. using anonymous proxies

4. by switching the proxy for each page request

5. and at the end of the project, zip all downloaded files into one file for easy download.

The script will be launched through a web-page which will have a form where I can input project name and upload a text file. The text file will have 1000s of URLs of dynamic pages like:

[url removed, login to view]

or

[url removed, login to view];State=gigcsvvd

Sometimes the URLs can be of secure pages https://

Now, I use wget to download the pages. But my requirements are growing and it wont be possible for me to manage the same way for long.

It is very important for the script to use anonymous proxies and keep changing them dynamically as the web-servers will deny repeated requests from the same IP.

The script should support multiple projects and maintain a log. It should update the status of each record which can be done by updating the same in the text file that I upload.

Thanks for your interest.

Eshwar

Habilidades: PHP

Ver mais: downloader php, php downloader, script php proxy web, download php 5.3, dynamic php downloader, php downloader web proxy, a2z, server changing, secure files, proxy php, proxies, php proxy, http web requests, download php, ANONYMOUS , update status script php, php download zip files, php download files, proxy aspx, status update script, upload http request, update lists, http proxy request, php download files zip, php upload server

Acerca do Empregador:
( 99 comentários ) Pompano Beach, United States

ID do Projeto: #133181