Twiter App in Python
A twitter based scrapping application. The basic idea of the app was to scrap twitter for specific tags for specific time and then collect those contents i.e. tweets into database. The collection is then processed for various type of data analysis which include \n+ positive Sentiment\n+ negative Sentiment\n+ word frequency histogram \n
Sobre Mim
I am a data engineer with more than 8 years of industry experience. Have both clouds and on-premises DE solutions deployment experience. I have expertise in the following areas. 1. Data ingestion in data lakes and data warehousing environments using SQOOP, Flume, Kafka and JMS. 2. Data analysis using Pig, Hive, Spark, MapReduce etc 3. Building real-time data pipelines using Apache Nifi, Kafka, Spark Streaming, Hive. 4. HDP and HDF cluster administration, troubleshooting and bug fixing both in AWS clouds and commodity 5. Building data ingestion and analytics pipelines using Spark in AWS EMR, Dynamodb, S3, Athena and Redshift, EDW with Redshift 6. DevOps in data lakes and EDW Environment using Jenkins, Docker, Git 7. Some experience in System Administration mainly in RHEL family. I am holding AWS Solution Architect Certification and have good visibility in AWS services and community. I am looking forward to long-term relationship where I can contribute real value to the customer systems.
