Apache Spark performance tuning required(High proficiency required)

Job Description:

Currently I have a job which does some aggregations and takes a day or two but I have seen the same job completed within 30 mins with some unknown set of resource allocations.

Since I've been playing with Spark for few years, I am only looking for someone who is highly proficient with Spark resource allocation and fixing the data skew issues when encountered wide transformations/aggregations(apart from salting techniques)

Habilidades: Apache Spark, Amazon S3, Python, Scala

Sobre o Cliente:
( 0 comentários ) Phoenix, United States

ID do Projeto: #35403543

1 freelancer está ofertando em mádia $50 para esse projeto


Hey there ! Good day. I am Pankaj Ranga I would like to work with your project and I can surely provide the details you have specified on the project description. I can confidently say that I am knowledgeable enough to Mais

$50 USD / hora
(1 Comentário)