Em Andamento

wget scraper using bash

I need a bash script that will spider a webpage in a certain manner.

This must be done using bash and wget. It should also use grep, sed or awk.

## Deliverables

The script will download a webpage, extract the urls, follow the urls. It will follow and download another URL, then extract an image.

The pages use obfuscated URLs so they need to be extracted and wget needs to rename the file as it downloads.

All the pages followed have the same Layout, only different information.

The script must determine if the first page is paginated, and if so repeat this process for the next page in the pagination and finish until it is done. If the page is paginated, it will need to re-download using a new URL parameter.

This must be done with bash and wget. It may use grep, sed or awk. It should also use an array.

Habilidades: Engenharia, Linux, MySQL, PHP, Gestão de projetos, Arquitetura de software, Teste de Software

Ver mais: bash url scraper, bash wget scraper, using re, bash file, bash 0, linux bash script, bash script, awk, rename url, follow follow download, download image url, php parameter url, wget, linux url scraper, page scraper script, extract image script, php image pagination, image scraper php, grep awk, scraper download, image spider, obfuscated php, bash download extract, rename image using, image download rename

Acerca do Empregador:
( 46 comentários ) United States

ID do Projeto: #3004471

Premiar a:

kingcodersl

See private message.

$42.5 USD em 14 dias
(75 Avaliações)
4.6

2 freelancers estão ofertando em média $32 para este trabalho

voicedat

See private message.

$21.25 USD in 14 dias
(7 Comentários)
2.9