Log Processing using Amazon EMR, S3, RedShift and Tableau

My JAVA application is configured to remote logs all the entries using Papertrail. Papertrail combines log files from all EC2 servers and puts them on S3.

I need to parse these log files, extract relevant information using Amazon EMR and then put them under Amazon Redshift. Then I would like Tableau to connect to Redshift and give me analytics report on this data.

This entire process should be connected all the time so that I can get live data within Tableau.

Initially, I only need 1 specific kind of entries extracted from the log files which have the same structure.

Please let me know if you will be interested in this job. Please respond back with estimate time frame and cost.

Let me know if more information is needed


Habilidades: Amazon Web Services, Hadoop, Java, Map Reduce

Veja mais: c using data structure, amazon web services job, tableau report, log time, log me in, amazon web services s3, amazon job application, log files, EMR, ec2 extract files, let log, parse log, emr application, ec2 amazon, java log, emr web, time log, parse java, amazon log files, extract analytics data, job ec2, java data extract, extract web data amazon, parse files java, can parse log files

Acerca do Empregador:
( 0 comentários ) Irving, United States

ID do Projeto: #6819685

8 freelancers estão ofertando em média $688 para esse trabalho


I have 8 years experience in JAVA, J2EE, WebServices, REST Services, SOA, Amazon MWS, Amazon S3, and new to Amazon EMR, Amazon RedShift, Tableau. But I am very much interested in doing things. Note : you need to provi Mais

$750 USD in 15 dias
(50 Comentários)

Hello, sir. I'm interested in your job. I have experience in AMAZON EC2 and Hadoop. I want to work with you. Thanks. Regards

$736 USD in 10 dias
(12 Comentários)

I have done a couple hadoop/cloud computing related projects: Mais

$777 USD in 10 dias
(11 Comentários)

Hello, I am very interested in your project. Apparently I need to access your AWS account to get this done. My estimated time frame is 2-3 weeks for >$555 depending on what you need to extract and analyze.

$555 USD in 15 dias
(1 Comentário)

HI, after checking the initial requires i am here to show my interest I am an independent and professional developer experienced in Java, C# C++ .NET PhP, Mysql, HTML5, Mob Mais

$400 USD in 10 dias
(3 Comentários)

I'm very interested in this job. Please contact me for discussing the details. I am waiting for your prompt response. Good luck in all of your projects.

$555 USD in 10 dias
(0 Comentários)

A proposal has not yet been provided

$555 USD in 15 dias
(0 Comentários)

6+ years of experience in machine learning and master degree holder in computer science. Expertise in R,WEKA, JAVA,PYTHON, Hadoop, MapReduce. Worked on many projects in machine learning.

$833 USD in 30 dias
(0 Comentários)

Hi, I have 14 years of Linux and web server management experience. Though I am new here. You can check my linkedin profile at [url removed, login to view] Right now I am managing cloud deployments for Mais

$740 USD in 10 dias
(0 Comentários)