Create a download manager and scraper

Website crawler, scraper and file rename program I need software with the following functionality: 1. I will to start at a specific URL, such as: [login to view URL]; 2. This URL will create a start page full of links 3. Each one of these links will generate a new page. That newly generated page needs to be saved, with a user selectable extension. Each link from the start page will look similar to this: <span class="div8head"><a name="28:1.0.1.1.[login to view URL]" href="[login to view URL];sid=7ce7e2f8d1d7282ef32d1ab97f00c39c;c=ecfr;c=sampletc;xc=1;rgn=div8;view=text;cc=ecfr;node=28%3A1.0.1.1.[login to view URL]">&#167; 31.1 General.</a></span> The page that is created from this link needs to be saved as a file. 4. The file name that is created is made of parts of the link, and in the above example, looks like this: [login to view URL] 5. The file name is made of the “idno=xx;, user selectable text, and the number after the link, (and after the &#167; if this exists). 6. The following are user entered or controlled: 1. starting url 2. text string in the link, such as div6head, div7head, or div8head, where you only follow links with the text string 3. the extension 4. the text in the between the two found values in the link, such as “cfr” in the above example. 5. the order of the file name creation (in the above example, it could be [login to view URL], or [login to view URL], or 31.1cfr38.htm. or the user will have the option of saving all of the links on the page with first xx (a number) character of the starting url, incrementing the number and then choosing the file extension. For example: if the file came from [login to view URL], and the user selected "6" for the number and 'htm' for the file extension, the first link would create a file name of "[login to view URL]" in this example. Post any questions or clarifications you may have.