Big Data Python Developer/Engineer

Looking for an Expert in:

· Build Custom Data Pipelines in Python that Clean, Transform and Aggregate data from many different sources

· Big Data Technologies such as: MapReduce, Hadoop, Spark, HBase, Hive, Elastic Search

· Data Structures and Data Processing Algorithms and Frameworks

· Data Migration, high throughput Data Pipelines

· Massively Parallel Processing using Python Tools

· Ability to analyze Performance Issues in Big Data Environment

· Data Modelling, Data Transfer and Storage, Partitioning, Indexing and caching Techniques

Well experienced with:

· Large Scale Data Modelling from Big Data perspective

· Big Data Structures in Python

· PyData, Anaconda, numPy, PyTables, DataFrames, Jupyter Notebook

· PyHive, PySpark

· JSON/Parquet Data formats

· Real time streaming with either Spark Streaming of Kafka

Good to have:

· Familiarity with PyPi

· Workflow Management Tools such as Luigi, Apache Airflow, Snowflow or similar

Habilidades: Big Data Sales, Java, Python, Desenvolvimento de Software

Veja mais: pylab loadtxt python load big amount data, python data transfert via mdm, python data web site, python data scrape, python data entry, use python data website, python data website, python data scraping websites, developer post data iphone web, python data extraction, python parse big xml, software engineer developer cover letter, iphone developer sync data iphone, double developer bpo data entry job, load data big file mysql

Acerca do Empregador:
( 375 comentários ) Faridabad, India

ID do Projeto: #14521242