I need a bash script that will spider a webpage in a certain manner.
This must be done using bash and wget. It should also use grep, sed or awk.
The script will download a webpage, extract the urls, follow the urls. It will follow and download another URL, then extract an image.
The pages use obfuscated URLs so they need to be extracted and wget needs to rename the file as it downloads.
All the pages followed have the same Layout, only different information.
The script must determine if the first page is paginated, and if so repeat this process for the next page in the pagination and finish until it is done. If the page is paginated, it will need to re-download using a new URL parameter.
This must be done with bash and wget. It may use grep, sed or awk. It should also use an array.