Create program to crawl web for Wordpress sites

I would like to develop a simple program to crawl the internet and identify Wordpress sites. Being able to set a GEO zone would be preferred, USA to begin with.

The program should output the domain name, and also scrape an email address if possible.

This feature is advanced, and may be left until phase II if possible: The program should output a report on the site, identifying broken links, plugins, themes, etc.

Please bid with your experience developing similar programs. Outline other web scraping programs you have developed. GENERIC BIDS WILL BE IGNORED!


For now I just need bids on developing a script to determine if a list of domains that are input are WP or not. The program should do the following:

1. Determine if the domain is currently active, and not parked. The list of domains will be in the millions.
2. If the site is wordpress or not wordpress
3. Create 2 lists based on condition #2 and allocate to each name - The IP, location and email address (if possible)


Habilidades: Engenharia, PHP, Desenvolvimento de Software, Captura de dados na web, WordPress

Veja mais: wordpress sites develop, web site programs, web scraping programs, web scraping advanced, web developing programs, web developing program, usa wordpress, themes for wordpress, scraping the internet, program site web, programs for php web, is php web scraping, developing wordpress plugins, develop for wordpress, wordpress sites, Web Scraping email, web a, scrape for links, develop the program, create simple scraping, create a simple program, wordpress plugins develop, php crawl web, geo zone, crawl sites

Acerca do Empregador:
( 123 comentários ) Irvine, United States

ID do Projeto: #6791074

57 freelancers estão ofertando em média $577 para esse trabalho


Hello David, Great to see your project again. About the crawler websites, do you want a script auto get the info of a wordpress domain which you will enter to admin panel? We look forward to hearing from you soo Mais

$515 USD in 10 dias
(396 Comentários)

Hi, Thank you for reading our application. I would like to talk to you using Freelancer chat please, as i would like to make sure all the things are clear before making an official offer. Please know that the off Mais

$747 USD in 30 dias
(405 Comentários)

Hi, My name is Marat, I am CEO of WEB4PRO company located in Ukraine - We offer the services of web development on WordPress. I am interested in your project and able to perform tasks with differ Mais

$594 USD in 10 dias
(300 Comentários)

Hi Thanks for your valuable time. :-) Just reply with 'Yes' and We will come up with a. Detail project plan with our comments/queries. b. Best-feasible-real COST & TIMELINE We can a. Provide you stand Mais

$515 USD in 10 dias
(524 Comentários)

Seeing is believing, Let our work speak on our behalf. [url removed, login to view] We extract from the following:- 1. [url removed, login to view] 2. [url removed, login to view] 3. http://ww Mais

$750 USD in 5 dias
(23 Comentários)

1. Donation Site We already designed and developed a wordpress based site for donations in which we implemented paypal and paypal pro to take the payments from credit cards with a complete registration of donating per Mais

$594 USD in 12 dias
(96 Comentários)

Hello, Can you please elaborate your requirements ? So, We can identify the scope of work. Just ping me in chat for further discussion. Feel free to ask us any questions on this project or about our company prof Mais

$750 USD in 15 dias
(239 Comentários)

Hello, I have read your post and understood your requirement. I have great experience in handling Wordpress/PHP/Magento/Joomla/Drupal/Java/node.js/AngularJS Python/Django/Javascript/MySQL/ HTML5/CSS3/ Mais

$1030 USD in 10 dias
(69 Comentários)

Hello, We are a web development company having 5+ Years experienced team of web developers. Please check some similar work : [url removed, login to view] [url removed, login to view] Hope you like this. Looking Mais

$721 USD in 5 dias
(223 Comentários)

Hi I have gone through the details of your project and we find it well within our capabilities. I offer a wide range of services, including Web design, PHP/MySQL web application development, Open sources like Joo Mais

$515 USD in 14 dias
(297 Comentários)

Hi, You need a web crawler for the system. The system fetch the domain name and check it the site is wordpress. We have some question regarding your project requirement ----------------------------------------- Mais

$526 USD in 10 dias
(208 Comentários)

I am an expert in crawling and scraping willing to discuss further about the project specifications and needs.

$526 USD in 10 dias
(141 Comentários)

Hello, This is RajKumar from "Hire WordPress Experts" and I am here to help you with Create program to crawl web for Wordpress sites. We have gone through the information provided by you. and I can assure you that we Mais

$526 USD in 30 dias
(148 Comentários)

Please open the message box so we can discuss about your requirements clearly. Front-End: [url removed, login to view] Back-End: [url removed, login to view] User : nickt Mais

$515 USD in 10 dias
(34 Comentários)

Hi, We possess more than 7 years of experience in web development and fully proficient in PHP/MySql, html5/css3, Javascript. Please go through our profile and reviews. Following are some examples of our work; http:/ Mais

$500 USD in 10 dias
(93 Comentários)

We are expert in designing and [url removed, login to view] have seen the proejct [url removed, login to view] can do it. Please have a look at below link. [url removed, login to view] [url removed, login to view] [url removed, login to view] http://chri Mais

$444 USD in 10 dias
(119 Comentários)

Hello!! I'd like to express my interest in doing this assignment for you. We are highly experienced in Custom Responsive/ Mobile friendly WordPress Development, PSD to WordPress, Landing Page Design, Joomla, Drupal, Mais

$526 USD in 10 dias
(124 Comentários)

Hello, I am an PHP Certified Developer with more than 7 years of experience and shall get this done in about 12 days' time. Let me know if you have any doubts / queries about my expertise, will be more than hap Mais

$736 USD in 12 dias
(96 Comentários)

If you want a quality site for a fair price contact me! Custom sites, all programming languages and database types. Sites include administrative back end systems. All bids and durations are just an estimate until you c Mais

$789 USD in 15 dias
(32 Comentários)

Hey Friend, Myself having has 10 + years experience of web site development. Expert in Custom programming in php / Mysql / Jquery / Wordpress/ Joomla / OSC / OpenCart. Ready to start the work immediately. I am co Mais

$500 USD in 10 dias
(135 Comentários)