Em Andamento

wget scraper using bash

I need a bash script that will spider a webpage in a certain manner.

This must be done using bash and wget. It should also use grep, sed or awk.

## Deliverables

The script will download a webpage, extract the urls, follow the urls. It will follow and download another URL, then extract an image.

The pages use obfuscated URLs so they need to be extracted and wget needs to rename the file as it downloads.

All the pages followed have the same Layout, only different information.

The script must determine if the first page is paginated, and if so repeat this process for the next page in the pagination and finish until it is done. If the page is paginated, it will need to re-download using a new URL parameter.

This must be done with bash and wget. It may use grep, sed or awk. It should also use an array.

Habilidades: Engenharia, Linux, MySQL, PHP, Gestão de projetos, Arquitetura de software, Teste de Software

Ver mais: using re, bash file, bash 0, linux bash script, bash script, awk, rename url, download image url, php parameter url, wget, extract image script, php image pagination, grep awk, image spider, bash download extract, rename image using, image download rename, spider extract, bash rename script, script bash, php download wget, sed script, php script extract image, pagination php script, wget spider

Acerca do Empregador:
( 46 comentários ) United States

ID do Projeto: #3004471

Premiar a:


See private message.

$42.5 USD em 14 dias
(75 Avaliações)

2 freelancers estão ofertando em média $32 para este trabalho


See private message.

$21.25 USD in 14 dias
(7 Comentários)