I need an expired domain miner, and it must analyze moz and majestic metrics using api

I basically want a program to run on my 4gb or 8gb ram computer that will crawl a list of 200,000 urls to find all external broken links so that I can find potential high authority domains I can register. I'd need to have a variable search depth, at least 2 pages deep to find enough domains. Even if 200k urls finds 20 million internal/external links, it must still run without dying and freezing. This is the problem with most programs such as xenu, screaming frog, and several others, none of them can handle a large scale of scanning. I want BIG

It must check for domain availability, prob using an api such as namecheap.

It must then check metrics for each available domain with a www. and without.

It must gather metrics such as PA/DA/CF/TF/cftf ratio/backlinks/mozrank using api's

It must not freeze

It must be consistent

It must be fast

It may need to save automatically as well

Continued maintenance or support would be appreciated as well.

Here's some examples of similar expired domain finders:

[url removed, login to view]

xenu - this is slow and freezes everytime it reaches 2 million found links

screaming frog - this is slow and freezes and runs out of memory

expired domain miner - this is twice as fast as xenu but not at all good enough.

[url removed, login to view] - this is slow, expensive, freezes, and is dead atm

[url removed, login to view] - this is dead atm

Let me know if you know of some software to crawl tons of urls for broken links and prices or if you can build one yourself.

Habilidades: Programação C#, Programação C++ , Engenharia, PHP, Arquitetura de software

Ver mais: youtube fast search, examples computer programs, cf software, youtube search api, computer programs list, using api, prob, namecheap, metrics, majestic, freezing, find domain, expired domains, domain authority, atm software program, expired domain miner, moz authority, domain computer, need authority, moz domain authority, moz api, moz domain, need 200k fast, miner program, crawl expired domains

Acerca do Empregador:
( 5 comentários ) Bakersfield, United States

ID do Projeto: #6841980

10 freelancers estão ofertando em média $246 para este trabalho


I am an expert in delivering custom scripts and tools willing to discuss further about the project needs.

$252 USD in 5 dias
(166 Comentários)

Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bu Mais

$268 USD in 8 dias
(17 Comentários)

Hello, We have excellent team of programmers and designers to work on your project efficiently and complete job in time. We have read your deepest requirement at our best and will surely give better results. thanks

$263 USD in 8 dias
(23 Comentários)

A proposal has not yet been provided

$333 USD in 3 dias
(9 Comentários)

Hi, We are a 1000 + employee firm. Charging $6 an hour. Can start any technology immediately. Direct access to developers via skype, G talk and hotline – 24/7 availability for all 1000+ resource. We can bet you t Mais

$226 USD in 3 dias
(3 Comentários)

A proposal has not yet been provided

$266 USD in 3 dias
(4 Comentários)

Hello, With more than 4+ years of experience in Web Application development, my expertise covers full range of web development services from a simple CMS based site to complicated web application and complete e-Comm Mais

$333 USD in 10 dias
(0 Comentários)

A proposal has not yet been provided

$222 USD in 3 dias
(0 Comentários)

Hi I am C# expert developer and i have some projects that works around the world, if you would like i can create this app for you

$444 USD in 10 dias
(0 Comentários)

Hi We have done a lot of website with these kind requirements. Here are some of our works. http://www.caratlane.com/ http://businessparkvienna.com/en http://rawww.com/ http://www.drinksmartwater.com/ www.sonuph Mais

$34 USD in 10 dias
(0 Comentários)

A proposal has not yet been provided

$155 USD in 3 dias
(0 Comentários)

A proposal has not yet been provided

$155 USD in 3 dias
(0 Comentários)