Data Engineering Consultant. Strong Data Architecture, Designing. Expert skills in python, PySpark, Data migration, Advisory & Consulting. Working experience with Infosys, DXC Technologies, Global Payment and Fractal Analytics
TechStacks:
Python, Pyspark , SQL, Hive, Sqoop, HDFS, Airflow
- Architect, Designer with Strong Data Anlytics experinece.
- Building Data pipeline, Data migration skills.
- Worked with ETL tools and Big data, hadoop with Spark experience.
- Build insights using Python programming with various tools, platforms, and systems such as: Apache Spark
- Working in CI/CD pipelines.
- Development using a variety of languages which may include Python, Java Script, Hive, Spark, sqoop.
- Design, develop, and implement complex reports and analytics
- Use advanced data and coding techniques to provide concise and compelling summary of analysis findings in reports and presentations
- Comfortable working with SQL/NoSQL.
- An advocate of agile practices for rapid development of quality software, such as CI, TDD and automated deployment.
- Write scala programs that scales to petabytes of data and supports millions of transactions a second
- Write and review pull requests in Git
- Leverage various data and technology resources to augment analysis
- Experience with Spark or the Hadoop ecosystem and similar frameworks is ideal for this role.