Java Web Site Screen-Scrape Webcrawler Application

Java Web Site Screen-Scrape Webcrawler Application

Our firm seeks a prototype for a java application to log onto a web site, navigate to an appropriate location in that web site, capture and collect specific data, dump it to a text file, and store it in a mySQL database.

The utility you deliver must be launched from a command line as follows:

java -jar [url removed, login to view] siteloginURL username password inputfile

Input file must be CSV file format containing:

FirstName, LastInitial, customer number, date of birth, gender

Output must be a file for every query from input and its matching mySQL record.

Deliverable must be a working prototype that demonstrates the functionality, associated compilable source code, in line documentation, and instructions on recompilation.

Additional Clarification: Keep in mind that this is a prototype. It simply has to demonstrate the basic screen scrape technique (preferrably on more complex DHTML, Java Script, and Framed pages). For now we are not concerned with the actual site to scrape from (use any you like that requires login). Right now we are using mySQL [url removed, login to view] auto-configured by Joomla JSAS.... but feel free to recommend that we use any other mySQL instantiation (so long as it is not too difficult for us to set up). Also, we will need to be able to recompile your prototype when we get it... so you need to provide some environment setup and config instructions.

Also, there is a good chance that if we are happy with what you produce, in a follow-on contract, we will ask you to extend your prototype and eventually provide the actual production site (or sites) that require data collection.

Habilidades: Processamento de dados, Java, Linux

Veja mais: java website screenshot, java site screen, website capture java, screen scraping utility java post, screen scrape java, java web crawler, web crawler login scrape, scrape java, screen scrape java application, java screen scrape, your free web site, what is a web script, web source format, web free, web format, use of collection in java, seeks, screen of the mind, prototype date, prototype auto, production line, long web pages, joomla web pages, joomla in java, joomla for java

Acerca do Empregador:
( 11 comentários ) Sewalls Point, United States

ID do Projeto: #173515

Concedido a:


Hi, Please see Private Message. Dan

$125 USD em 11 dias
(7 Comentários)

7 freelancers estão ofertando em média $246 para esse trabalho


Hi,I am a data extraction specialist. Please check PMB. Thank you

$300 USD in 4 dias
(16 Comentários)

i can do this for u.

$150 USD in 7 dias
(20 Comentários)

Can help...

$300 USD in 15 dias
(9 Comentários)

I can provide you the right solution in java for b the prototype to capture and store contents of a website as [url removed, login to view] regards Antony Thomas

$300 USD in 10 dias
(1 Comentário)

Dear Sir, I am more than 10 years experienced coder and softeare engineer.

$250 USD in 15 dias
(0 Comentários)

This is a Java professional with 4 years experience. Hands on frmaeworks like Struts,Spring, Hibernate,web service, etc. Have worked with companies like IBM,Fidelity,Reliance. This is just to make you comfortable wit Mais

$300 USD in 10 dias
(0 Comentários)