I need to be able to continuously search, collect, categorize every single domain on the internet. I need to be able to separate the results by domain extension. If a valid domain is found then if it is the database it will not be searched for again.
Need to retain only the domains that have proper forward and reverse records. Hence a forward and reverse record that points to the same ip address. an exampel of this would be [url removed, login to view]
1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Installation package that will install the software (in ready-to-run condition) on the platform(s) specified in this bid request. 3) Complete ownership and distribution copyrights to all work purchased.
I need to be able to select by extension(s) the domains I choose to pull out of the database and when I do so these domains are flagged and will not pulled from the database again. When an export is requested.
Each domain will also checked for DNS server response time. And domains will be rechecked before a final export. I will be able to set a threshold level cutoff of depending on the responsiveness of the DNS servers associated with the domain. I need you to come up with some sort of tool to with the program that allows me to set and adjust this variable.
Need a visual reference reporting of
How many domains collected total
Which domain extensions and how many.
How many collected per an hour ??" per a day ??" per a domain searched.
Speeds of domains ??" averages.
Need overall stat information to direct the program ??" hence .ws may have less domains then .ca -
I will connect to this sever remotely ??" something like webmin access to the server to administer this program would be nice.
The program exports the dns domains 1 per a line into a txt field format that I can download or view on the web and copy and paste. I need the option to have the output to be randomized. Or be domain extension alphabetically.
Application ??" needs to be super fast an efficient ??" run on linux redhat 9.0 ??" with a mysql database. ??" the programming language I need you to recommend what you want to use. I was thinking -