For example extract all the links from [login to view URL]
that point to articles.
Then get those links.
Only get links which have not been scraped before (i.e. get the new links since last scrape).
Must not scrape links to external websites.
Must not scrape links to other parts of the website - e.g. jump to [login to view URL] from news.
Needs to work on all different types of websites/ blogs.
Basically it needs to be able to tell the difference between article/ content page and between settings/ privacy type pages
17 freelancers estão ofertando em média £142 nesse trabalho
Hello, I believe I can do this, as I have an experience in web scrapping as part of my research paper which is not published in IEEE. Pease contact me to discuss further requirements of this.