Kafka data enrichment trabalhos
need sample service to store json into hive through kafka and spark java
This project can be divided into three parts: 1. An online cluster of computers which should come pre-installed with the necessary technology stack, including Apache Hadoop, Apache Spark, Kafka, Python, R and other related technologies. 2. An online coding platform with a compiler that has all contemporary Languages. 3. An online platform to practice cyber security offerings All these platform will have an admin module and user module. Admin module can be used to publish competitions/allied activities and user module should take care of users participating in these challenges and also can practice. Both these modules should should have leaderboard in case of challenges. This project should come up with appropriate consultancy in terms of sizing the infra and in terms of hosting....
Beginning Big Data developer here who knows a little AWS, Hadoop, Spark, Python and Java looking for someone who can take me through the process of setting up a Spark + Kafka + Cassandra (or maybe MongoDB) streaming pipeline on AWS with multiple nodes (say, around 5 nodes, with EMR or EC2 or whatever makes the most sense). This is for getting myself started with setting up and running a semi--semi-realistic streaming pipeline to play around with for my self-education purposes, not for production, so a very basic "hello world" type setup doing the basics is what I am looking for. In other words, Kafka plus Spark streaming to process the input and put it into db, without anything too fancy in addition besides some trivial analytics or computations. You can m...
I have 1,995 companies in my database that are missing a primary website URL, which I need enriched. In addition, these companies are missing one or more of the following key data fields: - Annual Revenue: 798 - Employee count: 1915 - Billing State/Province: 798 - Billing Country: 801 - Primary Industry classification: 724 So I need bids on enriching this data list. I would provide an Excel spreadsheet with the existing data for enrichment. An ideal source would be
We are a children enrichment centre specialising in reaching children mandarin. Our slogan is "Chinese for Children. We specialise in it" We need a nice slogan for a wall poster
It is an ecommerce platform to sell cars parts. The platform will be build using Python, Django, Kafka
Hello, I am looking for an Hadoop and devops expert who worked on Java,Map-reduce,Spark streaming,kafka,HBase with devops tools like jenkins and cloud technology AWS. I need someone who can explain 5 real time projects with some documentation and code.
FLIGHT PLAN is a enrichment program for high school students that encourage STEM careers. The logo should be clean and centered around Aviation. It must be brandable
Need a application that can read all avro messages in Kafka Topics
...is about capturing the data generated by a device in a realtime and processing the data to derive some device metrics like device status and peripheral count. The project defines a part of real time requirement from the client on capturing and processing telemetry data from devices The data should be captured using the push model from 'REST' services by a realtime messaging system like 'Kafka' and processed by application services using the kafka libraries and derive the device specific metrics and store in MongoDB. Later on after deriving the metrics, same are to be retrived and represented using a dashboard. The project should be executed as microservices by leveraging cloud infrastructure. There exists a lot of scope for l...
I'm looking for someone to teach me how to stream data from a MySQL database and write it directly into another (consume?). The database to be written to is a MySQl database in Google Cloud Platform. Tools I'm interested in include, but not limited to, maxwell's daemon, kafka, and/or whatever you think is a better solution fot performing this type of task.
We need a single dedicated part time resource on kafka, python with aws to give support on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 20000 per month minimum 4+ years of experience candidates only eligible for the bid.
The VISTA Team Access Mentoring & Outreach programme provides target mentoring support and guidance to children and young people across a wide range of groups within targeted children and adolescent services. At VISTA we believe sport and enrichment activities provides a platform to build and develop skills which transition into every day life. Logo required for upcoming presentation and future marketing , branding and promotional material !
Hello , I am looking for someone who can explain me kafka/Hbase and Hive project(s) on Spark, worked real-time challenges / issues and provided solutions to fix them. Thanks,
Optimization of Kafka and Kafka Streams pipeline for performance/ throughput. Please apply if you have worked on this stack especially in performance tuning.
I own a children's enrichment program and need a form made for evaluations. I have an example of what I need.
I need someone to write simple Apache Kafka consumer and wrap around it
JAVA Backend developer- Expert in writing JUNIT in intellij IDE Hi there i am working on Java backend there are already written methods i am not good at Junits, i need someone to write Junits for that particular method by starting with writing Junits for sub methods. I am strict on time contraints - task has to be done in 1 hour/method (total 3 main methods and ... I am strict on time contraints - task has to be done in 1 hour/method (total 3 main methods and around 5 or more smaller sub methods). I have 5 hours or less for you on this. I want smart quickly finishing people, please don't waste my time in trying, i can evaluate fast in less time, if it works thats great very important you must know how to use IDE: intelliJ, JUNIT tests for springboot Kafka Zookeeper Expe...
Java Backend developer JUNITS** Hi there i am working on Java backend there are already written methods i am not good at Junits, i need someone to write Junits for that particular method by starting with writing Junits for sub methods. I am strict on time contraints - task has to be done in 1 hour/method (total 3 main method... I am strict on time contraints - task has to be done in 1 hour/method (total 3 main methods and around 5 or more smaller sub methods). I have 5 hours or less for you on this. I want smart quickly finishing people, please don't waste my time in trying, i can evaluate fast in less time, if it works thats great very important you must know how to use IDE: intelliJ, JUNIT tests for springboot Kafka Zookeeper Genuine work Experience - Smart to finish ...
Seeking to hire a Senior Java developer with great knowledge in building scalable microservices to help me with a project i am working on. Key things to know to work on this will be knowledge of cqrs and event sourcing, i am currently using Axonframework, but open to use a more widely available framework. I use Gradle for dependency management, Kafka as my event bus.
We are about to create an advanced modern web application that would leverage the cloud to deliver recruiting as a service to...(Machine Learning) 13. Comfortable with building web solutions that can work on several platforms (mobile, desktop, etc) 7. Comfortable with modern front end technologies like (AngularJS, ReactJS, etc) 14. Comfortable with leveraging containerization (Docker, Kubernetes) to improve the overall deployment efficiency. 15. Comfortable with leveraging advanced stream processing frameworks like Apache Kafka The Developer/architect would provide project design and implementation plan as deliverables. If you are a serious and experienced Developer/ architect, feel free to apply for this position. The time frame would be between 1 to 4 weeks to complete the del...
We are about to create an advanced modern web application that would leverage the cloud to deliver recruiting as a service to...(Machine Learning) 13. Comfortable with building web solutions that can work on several platforms (mobile, desktop, etc) 7. Comfortable with modern front end technologies like (AngularJS, ReactJS, etc) 14. Comfortable with leveraging containerization (Docker, Kubernetes) to improve the overall deployment efficiency. 15. Comfortable with leveraging advanced stream processing frameworks like Apache Kafka The Developer/architect would provide project design and implementation plan as deliverables. If you are a serious and experienced Developer/ architect, feel free to apply for this position. The time frame would be between 1 to 4 weeks to complete the del...
I need the help of a programmer to design and develop a monitoring and alerting system using FluentD, Graphite, InfluxDB/Cassandra and Python. Experience with Kafka, Grafana and Spark may also be required.
Looking to build Api's using Microservices Architecture . It will be multi year project . Send me a POC . Best proposed detailed proof of concept will be awarded this project . Tech Stack we need to use : Swagger, Springboot ,Hibernate , Mongodb , Aws , AWS Api gateway , Splunk ,Kafka. Send me prons and cons of each tech stack also . Send me an architectural dia with details giving end to end flow . Overview: In this project we need to build api's which will call other api's and also our api will be consumed by other Teams . Our API will be doing basic CRUD operation . ( without Delete ) . If your POC is selected you will be awarded this project and will continue work on this project for atleast 1 year . Also you will be paid $30 if your POC is shortlisted by...
Build a Web app , see attachments 1-)The project requires detection of distributed denial of service attack in sdn environment by using s-flow(sample flow) technology. 2-)The project should be performed with ONOS Controller and it is necessary to communicate multiple ONOS clusters. Two of them are sufficient. 3-) Distributed clusters should be able to send ping request from one host under ...ping request from one host under the first cluster to another host under the second cluster. 4-)A web application should be developed and the application should communicate both ONOS endpoint and s-flow switch should be controlled and determined for which point on the network is under attack. 5-)In order to handle continuous flows, it is required to use a queue system like Apache Kafka.
...middle public school grades 6th-8th (ages 11-13). We want to highlight our new programs. 'Summer School' and 'program for gifted students'. We want to inform our neighbor community by sending a postcard. The following content must be present on the postcard; - Logo (attached) - Magnolia Science Academy - Highest Performing Middle School in San Diego - What's New At Magnolia? - Free Summer Enrichment Classes for Prospective & Current Students - Gate Seminar Program: advanced program for students who exceed the standards) - Include pictures demonstrating summer school classes such as yoga, archery, guitar. Include picture(s) demonstrating high achieving students (for the gate seminar program) Notes: - Emphasis education and success using a pos...
We are looking to get answers on some questions involving Software Architecture requiring integration of Kafka, Dibizium, postgreSQL, Scrapy, Scrapy-Cluster, Kubernetes & Docker & various web proxies or proxy services and other log-aggregation softwares with kafka. You must be someone who has used all these tools and has done some large scale scraping using scrapy, scrapyd/scrapy-cluster, collected log data from multiple vps & fed both types (scraped & log data) data to postgresql via kafka/dibizium. And various required dashboards for monitoring & analysis. We would require about an hour on chat and if required 15 minutes on phone. Chat will be in two stages, at different times on alternate days. You must be expert in the su...
I need to setup a project on azure. The project will be automatically deployed from Git and will have different services attached to it. Angular front, Java api back, elasticsearch, kafka ...
Project Description 1-)The project requires detection of distributed denial of service attack in sdn environment by using s-flow(sample flow) technology. 2-)The project should be performed with ONOS Controller and it is necessary to communicate multiple ONOS clusters. Two of them are sufficient. 3-) Distributed clusters should be able to send ping request from one host under the first clust...ping request from one host under the first cluster to another host under the second cluster. 4-)A web application should be developed and the application should communicate both ONOS endpoint and s-flow switch should be controlled and determined for which point on the network is under attack. 5-)In order to handle continuous flows, it is required to use a queue system like Apache Kafka.
Environment : spark-2.3, kafka-0.10, Avro data, scala-2.11.8 Build pipeline to stream Avro data from kafka topic.
I need job support to complete client projects successfully. The person should be skilled in python, API's, Kafka and hive tables.
...does not matter. Please ask if you have any questions or if anything is unclear - or if I have missed something! :) POSTER/INFOGRAPHIC INFO: The headline should be: "Handle with care" Optional header or main focus picture: OR OR Optional subtitle: "A guide to switching handling methods" Text for picture: Provide a tunnel as enrichment in the home cage Text for picture: Guide the mice into the tunnel when picking them up Text for picture: Give them a choice whether to go in or out (& if you need to get them out, tip them gently backwards onto a safe place) Text for and/or picture: To lift the mice with your hands, scoop them up gently and let them move freely in your hand Text for
Need to setup and document Kafka installation for version 5.1.0 and configure SSL Zookeeper Broker Schema Registry Rest Proxy
...and private parties. We're looking for a data enhancement specialist to find and transfer data into our main database. This is a long term project that will require 15-20 hours per week. Compensation: $8 - $15 /hour. Deliverables: - Find and fill in all required customer data using provided information service platforms and other web services. - Provide the most up-to-date contact and demographic information, like emails, direct dials, mobile numbers, and addresses. - Provide notes to inform us of any abnormalities in the data - Provide 100 valid email data per day Requirements for the project: - Experience with Microsoft Excel or Google Sheets - Experience with LinkedIn Sales Navigator, ZoomInfo - Experience with data scraping tool, ...
I have a logo concept that needs refinement and enrichment.
I need Apache Kafka Experts, preferably experience with Cloud and extremely responsive.
Looking for an experienced data specialist for a data enrichment project. You will work with a team of international procurement experts in consolidating purchasing data to deepen our insights across multiple categories. The data has already been partially treated. There are three main components to the project: - Complete categorisation of the 72000+ lines of data into consistent grouping across five layers. - Conversion of Measures to lowest common shared measure (Kg, Litre, Unit) - Homogenisation of data, ensuring quality is consistent. Required Experience: - Strong working experience with Excel and prior experience treating large data sets is a must - A passion for data quality & an understanding of the importance of ...
Build a spark streaming application to consume kafka topics.
We are about to create a modern web application that would leverage the cloud to deliver recruiting as a service to job seekers and companies: W...with different systems 6. Comfortable with building web solutions that can work on several platforms (mobile, desktop, etc) 7. Comfortable with modern front end technologies like (AngularJS, ReactJS, etc) 8. Comfortable with leveraging containerization (Docker, Kubernetes) to improve the overall deployment efficiency. 9. Comfortable with leveraging advanced stream processing frameworks like apache kafka The architect would provide a project design and implementation plan as deliverables. If you are a serious and experienced architect, feel free to apply for this position. The time frame would be between 1 to 2 weeks to complete the del...
...user-level data from different applications' APIs. We will then process this data and use it in different ways to serve the user in our own application. In our application, each user will be subscribed to a "plan", that will determine the business logic to be applied to that user's data. This posting is for designing and building the backend using Java, Spring and PSQL. The backend will need to serve the front-end and will need to handle: 1. Typical administrative requests such as user signup, preferences changes and linking external applications through OAuth. 2. An admin panel for managing different attributes of "plans", assigning users to plans etc. 3. Requests from the front-end that pertain to business logic 4. Pull dat...
Hello - I have a non-profit that helps children and families with critical needs granting wishes for the children. Wishes can be a toy, by a superhero, a vaca...by a superhero, a vacation or anything an imagination of a child can dream. Their wishes are limitless. We are also not opposed to updating our logo as many people read it as I Wish and not 1(one)Wish I need logos in different variations to match my current logo Programs that I need logos for is 1Wish Kid 1Wish Pet 1Wish Travel Care 1Wish Store 1Wish Day 1Wish Events 1Wish Hospital Enrichment Programs our Tag line is Making a difference 1Wish at a time also 1Wish, 1Experience, 1Memory 1Impact I will be adding all logo awarded on our website, marketing materials and promotional products for children and fam...
...converting our Kafka cluster to Docker images and deploying them in existing Kubernetes cluster. The Kafka cluster consists of the following nodes: 1. Kafka brokers (KFK1, KFK2, KFK3) 2. Zookeeper nodes (ZK1, ZK2) 3. Kerberos server (KDC) Deliverables: 1. Docker images for Kafka broker, Zookeeper and Kerberos server 2. A Readme file that documents how to run these dockers to join and scale in the existing Kubernetes cluster, and any changes required to the Kubernetes configuration Notes: 1. There is no HDFS or any other Hadoop services running in the cluster other than Kafka and Zookeper. The preference is for setting up a stand-alone Kafka cluster (without using any commercial distributions like HortonWorks or Cloudera). 2. Kafka broke...
Need to modify a python code to do the following code 1 1. export jass config file and execute kinit to get ticket code 2 fix kerberos not working with python avro producer and consumer
Generic Data Capture and Service Solution We are looking for an expert software developer with experience of Big Data, Middleware technologies and Database technology. Good knowledge of Apache Spark, HDF5, Redis, Kafka, RabbitMQ, Windows, Java are very useful. We are also looking for developers with knowledge outside this area to offer alternative suggestions. We are interested in creating a generic database technology solution. The technology will capture the following types of Data: -- Numeric -- Strings -- JSON messaging -- XML messaging -- Pdf -- .txt -- Images Functionality -- Generic API to store any information in the core database. -- Perhaps multiple databases that form the core database ( time series, relational, noSQL ). -- Generic API to req...
We are about to create an advanced modern web application that would leverage the cloud to deliver recruiting as a service to job seekers and companies:...(Machine Learning) 6. Comfortable with building web solutions that can work on several platforms (mobile, desktop, etc) 7. Comfortable with modern front end technologies like (AngularJS, ReactJS, etc) 8. Comfortable with leveraging containerization (Docker, Kubernetes) to improve the overall deployment efficiency. 9. Comfortable with leveraging advanced stream processing frameworks like Apache Kafka The architect would provide project design and implementation plan as deliverables. If you are a serious and experienced architect, feel free to apply for this position. The time frame would be between 1 to 2 weeks to complete the de...
I need some graphic design. H.O.P.E Hippotherapy Horses Offering Physiotherpeutic Enrichment
