We currently use [login to view URL] to crawl websites, but it wont follow javascript linked pages, we need a mod so it can follow javascript pages. With the result it been able to index [login to view URL] for example.
We currently use sphider plus([login to view URL]). Please download the crawler before bidding and have a look.
Thank you.