Big data developer

Big data developer

Project is a business intelligence type of solution dealing with data from different sources: logs, site visitors, CRM lists or purchase history data, etc. An EMR based solution is used to analyze and develop person-based marketing campaigns that can be deployed to any of the media platforms.

Tech stack:

AWS: S3, EC2, Elastic Beanstalk, Aurora RDS, EMR

DB: MySQL (using Aurora DB from AWS)

Hadoop: Spark on top of AWS EMR

ETL: Apache Nifi

correction: AWS: S3, EC2, SQS, Aurora RDS, EMR


Experience as a Data Engineer

Knowledge of database design

Experience in Data warehousing, ETL, Data Quality, batch and stream processing.

Knowledge of Big Data stack - Hadoop, Hive, Spark, Kafka, etc.

Strong knowledge of SQL

Strong knowledge of object-oriented programming and design patterns

Knowledge of Scala, or proficient in a typed or functional language

Knowledge of NoSQL databases

Bachelor or Masters degree in Engineering/Computer Science/Math or related discipline


Experience with Google Cloud, AWS or Azure

Experience with Big Query

Experience with Kubernetes

Experience with Scrum

Experience with BDD

Knowledge of Machine Learning

Habilidades: Amazon Web Services, Hadoop, Hive, MySQL, Spark

Veja mais: big data entry project, i have big data entry project with high budget but i dont accept fake profiles in freelancer need original profiles with origina, big data developer freelance, big data developer technologies, big data developer vs big data analyst, big data developer resume, big data developer vs big data engineer, big data developer jobs, big data developer certification, big data developer course, big data developer salary, big data developer freelancer, big data freelancing project, big data hadoop project ideas, big data developer 11 best freelance, big data analytics project management pdf, big data capstone project ideas, big data developer requirements, big data developer job description, big data developer skills

Acerca do Empregador:
( 0 comentários ) St Petersburg, Russian Federation

ID do Projeto: #19010399

26 freelancers estão ofertando em média $39/hora para esse trabalho


Hi, After reading the description we really believe that this is the project which is perfectly matching with our big data department and we are experienced and confident to make your project a success. Only I will re Mais

$61 USD / hora
(12 Comentários)

I must say, what you require for 1 person to have that all with expert hands, would be a miracle. I would, however, say that i have knowledge and expertise of following areas and can learn the other where needed. Mais

$41 USD / hora
(12 Comentários)

Dear Client. Here is a senior starter of Big Data Technology. I'd like to improve your business with my ability. Enough successful experiences with OOP, RDBMS, NoSQL, AWS, GCP, Machine Learning, Deep Knowledge abo Mais

$41 USD / hora
(15 Comentários)

Everlytics is an Enterprise AI company headquartered in Singapore with an offshore development team in Bangalore, India. We as a team have an exhaustive technical skill set and have delivered a number of projects succe Mais

$33 USD / hora
(7 Comentários)

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MongoDB, Postgre. I implemented above using Java Scala and Python. Mais

$40 USD / hora
(27 Comentários)

Hello How are you. I have read your job description and it needs full stack technical knowledge. Of course I am familiar to AWS(RDS, EC2, S3 bucket ... ) and have managed server there. Seriously most of tech is not Mais

$41 USD / hora
(2 Comentários)

Have 10 years of IT experience with more than 4.5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experience in Java,scala,Python and shell scripting. Wor Mais

$25 USD / hora
(12 Comentários)

I have been playing with data all my career I have been using Googles ML kit and Tenserflow these days for ML. I also have knowledge of all the tech stack you have mentioned Kindly message me so that we can discu Mais

$41 USD / hora
(4 Comentários)

I saw your posting and thought we might be a good fit. We are a full stack development firm with a wide range of experience in development. Our team is highly capable and have worked with companies including Airbnb, PN Mais

$55 USD / hora
(3 Comentários)

Hi sir, I have recently worked on a project in which I used market data and used Neural networks to predict when a person is going to change his mobile set. It is one of my successful projects. I am willing to work mor Mais

$41 USD / hora
(3 Comentários)

Hello, how are you today? I would love the opportunity to discuss this project with you. I think I am a good fit for this project because I have all the qualities that you are looking for. Experience is the gol Mais

$41 USD / hora
(8 Comentários)

Dear sir, I'm sure that I can complete your project 'Big data developer' as soon as possible. I am senior software developer and always provide fast service. I promise a high quality and punctual work :) Skills: Ama Mais

$41 USD / hora
(1 Comentário)

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha Mais

$25 USD / hora
(3 Comentários)

I am aws certified professional. I can help you with this project . I have done automation extracting the data from google to AWS .

$50 USD / hora
(1 Comentário)

Hi there, I’d like to be considered for your job position. I’m a Software Developer with a strong background developing Desktop application. My expertise skills are Java , JSP , Spring , Hibernate , BigData, JavaSc Mais

$30 USD / hora
(2 Comentários)

Hello there, This is Tahsinul Alam, CEO of Workspace InfoTech Australia PTY Limited. We have 52 engineers in 14 teams who are serving the world wide client in different ways. Our expertise are given below: Techn Mais

$41 USD / hora
(0 Comentários)

Hello, Hope you are doing absolutely great. Instead of writing a Proposal I would like to approach you directly for this job, as we have been working on the AWS for last 3 years. Let's take this forward as it loo Mais

$41 USD / hora
(0 Comentários)

Hello, I am a certified Cloudera and Hortonworks professional with 3+ years of experience performing analytics on Hadoop using Hive, Impala with YARN and SPARK. I also have a strong knowledge on SQL, MySQL and a lit Mais

$27 USD / hora
(0 Comentários)

Hi, I'm a data analyst. I have knowledge of machine learning and spark. I worked on AI projects and big data problems.

$27 USD / hora
(0 Comentários)

My work experience and interaction with the required skill set on day to day basis. Reach out to me for more information

$36 USD / hora
(0 Comentários)