Find Jobs
Hire Freelancers

Help me to finish-tune up a java scraping project TODAY -- 3

$30-250 USD

Em Andamento
Publicado há quase 9 anos

$30-250 USD

Pago na entrega
Hello i'm looking for a senior developer to finish a project today. I need to add a gui to my project, some functionalities and improve speed between multithreading queries. I can pay a maximum of 70 usd. I'll hire the freelancer today. Thank you ______________________________________ What the project currently does? ______________________________________ Main goal is to obtain books data with contactable author. So are important both: book details and author contact details. To do this i loop in several nodes in a xml - called [login to view URL] - collecting the url of the bookstores. All the bookstores has the same layout, so the only change is the url itself. Every url i collect start a thread, which try to download the information of n books, starting from a number specified in [login to view URL] and finalizing in other number specified in [login to view URL] Because the way the bookstores is programmed, i first go to a form, search for the book' sku and then i go the search result and finaly i get the url of the book. Then i feed the url to an scraping api ([login to view URL] api) and i get the information of the book in a html table. Then i look for if the book has biography of the author, if so, i feed an api wich do a semantic analizis -called opencalais- and after get the answer in xml, and i get the important data like city where the author lives, email, and every contact detail. To get its phone and other relevant details, i feed another api -called intelius- which let me find all people named like the author living in specific city and i get phone numbers. So i put all the book information and the possilbe contact details in a row in a table in a html file Every succesful 50 records i start a new exportable file. Each export is a html file with a table which has in each row the information of a book and the associated author details and posible phones. The files exported includes a js file which let the user export the file to excel. What is required? _________________________________ Well, because i need to improve speed, I thought to start new threads (as set in [login to view URL]) to increase the number of threads querying a url, to download more than one book at once, save the data in a sqlite db and when it goes to ask if has contactable data in the author biography, then start a new thread in opencalais and if it gets data to feed intelius (city where the autor lives indeed), then start a new thread in intelius too, and add the information collected to the book record in the database in a new table in author table with the possible contact details. So the approach is increase the number of threads, and create a db (sqlite is the approach) to storage partial information, with book, and authors tables. I need help in design and program the new approach. All this scrapping information has log just in console and modifies the xml file so, its the way the user see the progress, but it needs a gui. Finally the gui must be able to export to excel the information too, so it needs some queries to the database and the exportability managment. ___ Other part is to get more information of new bookstores, increasing book information and narrowing the posibilites about the author contact details with the new bio information obtained ... well, may be it could be a second part of the project. ___ Project is attached.
ID do Projeto: 7920145

Sobre o projeto

4 propostas
Projeto remoto
Ativo há 9 anos

Quer ganhar algum dinheiro?

Benefícios de ofertar no Freelancer

Defina seu orçamento e seu prazo
Seja pago pelo seu trabalho
Descreva sua proposta
É grátis para se inscrever e fazer ofertas em trabalhos
4 freelancers estão ofertando em média $73 USD for esse trabalho
Avatar do Usuário
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$71 USD em 2 dias
5,0 (353 avaliações)
7,9
7,9
Avatar do Usuário
Hi, I can complete the requirements but i will need 4 days to complete and wont be able to complete today itself. Thanks
$77 USD em 4 dias
4,9 (30 avaliações)
5,4
5,4
Avatar do Usuário
I have 5 years of programming experience. I can help you solve this problem. When you work with me you will feel very comfortable.
$72 USD em 3 dias
4,8 (53 avaliações)
4,9
4,9
Avatar do Usuário
Hi, I am a java programmer and quite an expert in creating bots/scrapers. Please check the kind of jobs that I have done and the feedback that I have got. If you can do something on web manually, chances are high that I might create a bot that will do that automatically for you. Ping me to discuss things in detail. Thanks
$70 USD em 1 dia
5,0 (12 avaliações)
3,8
3,8

Sobre o cliente

Bandeira do(a) MEXICO
QUERETARO, Mexico
5,0
12
Membro desde nov. 13, 2013

Verificação do Cliente

Obrigado! Te enviamos um link por e-mail para que você possa reivindicar seu crédito gratuito.
Algo deu errado ao enviar seu e-mail. Por favor, tente novamente.
Usuários Registrados Total de Trabalhos Publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Carregando pré-visualização
Permissão concedida para Geolocalização.
Sua sessão expirou e você foi desconectado. Por favor, faça login novamente.