Looking Some Help with Scala and Apache Spark to solve a problem


1) First Data frame is created with the values shown as above

2) Take Parent id of first row from the bottom and compare that value with the Child ID in the the second data frame . If an entry is found under child node , We need to extract that Child Node ID , Type and Level and add it to the first data frame at the top of the row .

In the above example , 100336 Parent id from the first data frame is selected and compared in the second data frame . Since the value is found under the child node , I have extracted that and put it into above 3 rows . Color highlighted above

3) One we make an entry with that combination ,we need to add the value from Data frame1 to final table with that combination . We need to traverse from bottom to top with the same appraoch

4) To Calculate Value 1 , Formual is , Value of Child ID * Value 1 of Parent ID / SUM( Value of All Parent ID ) . I. have given example above

Habilidades: Scala, Apache Spark

Sobre o Cliente:
( 0 comentários ) Apex, United States

ID do Projeto: #33925917

5 freelancers estão ofertando em média $214 nesse trabalho


I have 7 years of experience in Spark and Scala. Please contact so that we can discuss further on the project and proceed. Thanks

$180 USD in 2 dias
(5 Comentários)

Hi, I have more that 7+years of experience in Hadoop technologies like HDFS, MapReduce, python, pypark, Java,Scala, Hive etc. Please review my profile for skills. contact me.

$250 USD in 4 dias
(3 Comentários)

============Expert Ready============ Hi Dear. Scala expert is here. I have rich experience in Scala with 5+ years of development. I have read your post carefully and motivated to bid as a efficient developer. I am sure Mais

$250 USD in 7 dias
(1 Comentário)

Hi there, How r u? I have had a look at ur project i can handle it well as i have experience in Apache Spark and Scala. I have worked on similar projects before too. Please initiate the chat and discuss in detail. Wait Mais

$250 USD in 7 dias
(0 Comentários)

hi, i am working in a Big data company in China,i have 5+ years of experience in spark flink hbase etc.i have saw you Excel. i know how to solve this project.i will give you big discount cause its my first order,pleas Mais

$140 USD in 7 dias
(0 Comentários)