Find Jobs
Hire Freelancers

Nutch expert needed

$15-25 USD / hour

Concluído
Publicado há quase 8 anos

$15-25 USD / hour

We have a project to scrap data and to store data in hdfs. We need a skilled engineer to assistant in this task. Your work will be to implement Nutch and to get Nutch running as a demo to scrap data and store the data in hdfs. You will need skills as follows - 1. Ubuntu 14.04, this is command based with commands to manipulate files, install software, and log data 2. Java 1.7 with Eclipse, understanding classes, methods, debugging, maven, jar files. 3. Nutch, understanding how to scrap data 4. HDFS & Hadoop - understanding how to get HDFS working and to integrate with Nutch. This is a demo project and no production level data is needed but we need the basic system to work effective. Any knowledge of Javascript and scraping Javascript websites is a bonus. An extra bonus is knowledge of elasticsearch.
ID do Projeto: 10794973

Sobre o projeto

20 propostas
Projeto remoto
Ativo há 8 anos

Quer ganhar algum dinheiro?

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo
Seja pago pelo seu trabalho
Descreva sua proposta
É grátis para se inscrever e fazer ofertas em trabalhos
Concedido a:
Avatar do Usuário
$15 USD em 10 dias
0,0 (0 avaliações)
1,9
1,9
20 freelancers estão ofertando em média $22 USD/hora for esse trabalho
Avatar do Usuário
We are web & mobile development team of JinDongZhe freelancer We have powerful back-end(Java,Spring Framework, Hibernate, JPA, Oracle, Hadoop etc) and front-end(Android, iPhone, Hybrid App, Mobile web, Sencha ExtJS, Sencha Touch, etc) technology. Please lookup our portfolio carefully. We are going to consult with many friends sincerely Best reguards
$21 USD em 10 dias
4,8 (114 avaliações)
7,5
7,5
Avatar do Usuário
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta
$22 USD em 10 dias
4,9 (75 avaliações)
7,4
7,4
Avatar do Usuário
Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites including yellowpages, yelp and e-commerce websites including amazon, walmart etc and many more. We can deliver the data very quickly. We use proxies with IP rotation to avoid being detected as bots. We use Scrapy, Nutch for scraping data with proxies and other settings. . We have gone through your requirements. We have extensive experience in nutch and hadoop and basic knowledge of Lucene and Elastic Search. We have the right skill set to do this job effectively and within time and would like to discuss more about this opportunity. Looking forward to hear from you. Thanks, Shiv Agrawal
$21 USD em 10 dias
4,9 (49 avaliações)
6,2
6,2
Avatar do Usuário
Dear Client, Greetings from Flowgica technologies, I have experience with these skills. We do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead. please check our freelancer portfolio at https://www.freelancer.com/u/mmadi.html?page=portfolio I am ready to work with you,kindly waiting for your response. Thanks & Regards, Mmadi
$20 USD em 30 dias
5,0 (10 avaliações)
6,2
6,2
Avatar do Usuário
I am a Nutch expert and I have developed SEO engine by using Nutch. The final version of the Nutch is 2.3.1 and it updated very well. As you can see from my profile, I have a lot of skills and my main language was JAVA and this is directly related with Nutch. If you hire me, I will always focus on high quality work, fast delivery and good communication with you. please contact me for more detail. Best Regards.
$27 USD em 40 dias
5,0 (7 avaliações)
5,6
5,6
Avatar do Usuário
I am an IITK graduate and I have 9 years of experience in software development. I have 100% completion rate and I have finished all the projects with the highest level of customer satisfaction. I usually finish projects with ease on which other freelancers have already given up. I learn and understand new stuff very fast and finish the job with top quality and reliability.
$55 USD em 10 dias
4,0 (24 avaliações)
5,7
5,7
Avatar do Usuário
Hi, I have experience in using nutch for crawling. I have also customized the nutch crawler on one occassion. Apache Nutch was created by the creator of hadoop, and it is closely related with hadoop ecosystem projects HDFS, MapReduce, HBase and Nutch 2.0 can run with other NoSQL database backends like cassandra. Why this is relevant? I have expertise in most of the hadoop ecosystem projects mentioned above and also worked with Nutch. I am having 12+ years of experience in developing java, scala based enterprise applications, hadoop, spark, ElasticSearch and other relational and NoSQL databases. In my previous nutch work, I customized the "parse" job of nutch to do parsing in specific way. Nutch iteratively performs the crawling steps from the given seed urls, i.e. generate -> fetch -> parse -> updatedb ->generate... Nutch provides the option of indexing the crawled pages in either ElasticSearch or Solr (both are search/indexing engines) based on Lucene. ElasticSearch has very powerful REST api and is distributed by design. Moreover, I have used ElasticSearch for more than 2 years in other projects as well, for full text search and analytics. I would be interested in doing the Nutch setup work, and am also capable of delivering further customizations/solutions on Nutch. I'm new to freelancer, but hope you would look at my profile and consider my experience.
$22 USD em 10 dias
5,0 (1 avaliação)
4,2
4,2
Avatar do Usuário
Already completed 5 projects in Hadoop and Big data with good accuracy. Have 6 years of IT Experience with 3+ purely on big data only
$25 USD em 10 dias
4,7 (2 avaliações)
3,8
3,8
Avatar do Usuário
My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & experience that is required to complete this project. I can show you some examples of my work. Please contact me to discuss your project.
$22 USD em 10 dias
5,0 (1 avaliação)
3,2
3,2
Avatar do Usuário
Experienced in setup of Nutch using Ambari and Hortonworks distribution. Time required to complete this demo project would depend on the scraping needs.
$15 USD em 10 dias
5,0 (1 avaliação)
2,4
2,4
Avatar do Usuário
school@CLI:~$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 14.04.4 LTS Release: 14.04 Codename: trusty school@CLI:~$
$16 USD em 10 dias
5,0 (1 avaliação)
2,0
2,0
Avatar do Usuário
Dear Sir/Madam, My name is Jenida from 41studio Website and Mobile Development Company in Indonesia. We are a group of mobile and web developers having expertise in developing web and mobile applications for over 7 years. 41studio comprises of a team that is keen, skilled, practiced and proficient who work dedicate on your projects and with your coveted directions. In the development process you can have access to contact our developer directly to talk and discuss with them day by day. You can hire full time (40 hours/week) individual professional (developer) or a team (developer, project manager, designer, tester) depending on your development requirement. We don't mind to sign the NDA if necessary. We are able to work 40 hours a week, from Monday-Friday (09.00-17.00 GMT+07). We will provide 100% technical support from Planning, specification, wire frame, development coding,testing until launch and maintain. Once we get deal, you will be able to contact our developers directly to communicate through Skype, and beside that, we will give you report by the end of our work hours day-per-day to inform you what progress that we have made for your project everyday. I wish to hear your requirement in detail so that we can analyze it and provide you quality assistance for the same. Request you to even provide you contact details like skype ID for smooth conversation. I'm looking forward to hear from you Warm Regards, Jenida
$16 USD em 30 dias
0,0 (0 avaliações)
0,0
0,0
Avatar do Usuário
A proposal has not yet been provided
$16 USD em 15 dias
0,0 (0 avaliações)
0,0
0,0

Sobre o cliente

Bandeira do(a) UNITED KINGDOM
wos, United Kingdom
4,9
42
Método de pagamento verificado
Membro desde jun. 25, 2011

Verificação do Cliente

Obrigado! Te enviamos um link por e-mail para que você possa reivindicar seu crédito gratuito.
Algo deu errado ao enviar seu e-mail. Por favor, tente novamente.
Usuários Registrados Total de Trabalhos Publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Carregando pré-visualização
Permissão concedida para Geolocalização.
Sua sessão expirou e você foi desconectado. Por favor, faça login novamente.