Please reply with your expertise and how you would execute the project.
I would like to have a simple put powerful search engine.
We have about 150.000 domain url's that need to be indexed.
The server should be able to handle about 600.000 domains
It should not index outside those domains.
The speed of the bots visiting the 150.000 domains is essential.
Tell me together with your expertise what kind of files the bot can index.
The bot should visit all sites within each 3 to 6 months
If 1 server is not enough i should be able to add more servers to it.
The search box has to be POWERFUL, so if you search for "Republi" it show you "Republic", and if you search for "Black Cat" it should show you "Cat Black", and so on...
I would love to have a suggestion option (like google), if you misspell a word, but its ok not to have it.
Please only serious bidders, cash is ready