AWS Lambda and Glue

Encerrado Postado há 2 anos Pago na entrega
Encerrado Pago na entrega

1. A lambda function that triggers a glue job whenever a new gzip file is uploaded to S3

2. A glue job script that unzips the file and extract the json

3. If the extracted json is >1GB, split it into multiple files and make sure header is attached to all the splits with updated record count

4. Upload all the files back to another folder in S3.

Amazon Web Services Python Spark

ID do Projeto: #31259076

Sobre o projeto

14 propostas Projeto remoto Ativo em há 2 anos

14 freelancers estão ofertando em média $206 nesse trabalho

jframirezr22

Hi, hope you are doing well. I'm an Data engineer with 5 years experiences and familiar with Lambda and Glue. I got point what I have to do and thought my experiences could be helpful for your case. Could you provide m Mais

$250 USD in 4 dias
(11 Comentários)
5.4
umairkaramat24

Hi, how are you? I go through the description and read it carefully, I know exactly what you are looking for. I have 5+ years’ experience in these skills Spark, Python and Amazon Web Services. I have some question abo Mais

$250 USD in 9 dias
(15 Comentários)
4.6
MediatreeTn

hi iam iam expert in Amazon Aws and lambda and i can do a professional work for you my best regards

$250 USD in 7 dias
(8 Comentários)
4.7
Parveenlamba77

Hi there, Hope you are doing well. I am an IT professional with over 10 years of experience. I have great working exposure on AWS cloud services and automation. I can definitely help you in your requirement. Feel fre Mais

$140 USD in 7 dias
(16 Comentários)
4.7
ahmadndiayee

Hi, I am an experienced Data Engineer with a solid background in Spark and AWS. I have worked on many projects with Spark , Snowflake, AWS,... Let's have a call for more details about the project. Regards

$250 USD in 3 dias
(4 Comentários)
4.6
tilakputta

I'm well experienced in AWS services especially S3, lambda,sqs,ses,ec2 etc.. I will complete this very quickly and you will definitely be satisfied. please accept the bid, we can chat and finish this.

$111 USD em 1 dia
(2 Comentários)
1.0
jamesbarak600

AWS,PYTHON AND SPARK EXPERT HELLO, I have understood your SPECIFICATIONS for the task. I have over 6 YEARS’ experience in this field and have adverse experience since it is my area of specialization. My skills are ade Mais

$140 USD in 7 dias
(0 Comentários)
0.0
minhajarefeen

Hi, my name is Minhaj Arefeen. I see you need an AWS Lambda and Glue. I am a certified AWS Solution Architect, I have working experience of around 5+ years as an AWS Solutions Architect. I can help you with overall arc Mais

$200 USD in 7 dias
(0 Comentários)
0.0
shashanksharma55

Hi, Hope you are doing good! I'm certified aws data engineer having experience in - aws glue, lambda, s3, step function, redshift, sagemaker etc and I have used python/sql/pyspark for building data pipelines. I can Mais

$222 USD in 4 dias
(0 Comentários)
0.0
Danish0104

Hi, I am a AWS professional developer with more than 4 year of experience and I believe I can give you the best solution for your use case in 2 days of time.. this is my first bid I'm posting.. please give me an opport Mais

$200 USD in 2 dias
(0 Comentários)
0.0
nikcogni

Hi, I have 7 years of IT experience in AWS Development, Python and pyspark. I have expertise in different AWS services - Glue, Lambda, SQS, SNS, S3, Step Functions, Athena, EC2 etc. I did similar task in my project. I Mais

$225 USD in 3 dias
(0 Comentários)
0.0
nirajvalam

Hi I can help you with that..If you want to use open source ETL tool to complete this then also we can achieve that. thanks.

$278 USD in 3 dias
(0 Comentários)
0.0
neelamssethi

I have already worked on lambda triggers and SNS and SQS. Also being a senior software engineer and a data scientist, I have extensively worked on file manipulation

$140 USD in 7 dias
(0 Comentários)
0.0