Kafka data enrichment trabalhos
Continuar projeto de construção de nossa infraestrutura em kubernetes, com apache kafka, para filas, em ambiente de produção no google e homologação no Hostgator, migrar banco de dados Mongodb, para google, fazendo backup internamente no GCP e fora do google para termos redundância para um plano de contingencia, criar CI/CD para automatizar os processos de deploys.
oi Renato tenho projeto para Kafka teria interesse?
Oi Robson teria interesse em trabalhar num projeto de Kafka?
Enriquecimento de uma lista de aproximadamente 8 mil registros com os dados em uma base de dados brutos abertos. E informar API de consulta aberta para enriquecimento de dados posterior para consultas pontuais.
Boa tarde, gostaria de lançar um serviço SMS, com integração SMPP e menu USSD, e integração de cobrança de subscrição do siistema de cobrança da operadora de telecomunicações através de APIs. Exemplo de um serviço: Um cliente acede a um menu USSD, e selecciona uma opção de subscrição para um serviço de alerta SMS (exemplo: noticias). A subscriç...cobrança da operadora de telecomunicações através de APIs. Exemplo de um serviço: Um cliente acede a um menu USSD, e selecciona uma opção de subscrição para um serviço de alerta SMS (exemplo: noticias). A subscrição é c...
...uma aplicação simples IoT para aprendizado e que fará parte de minha pesquisa. <br />Atualmente, a aplicação trabalha com alto fluxo de dados e processamento em tempo real. Para isso, minhas premissas são: Java, Apache Storm, Apache Kafka, Apache Zookeeper e um gerador de JSON que irá alimentar o Kafka (tenho tentado utilizar este: ).<br /><br />O fluxo da aplicação é simples, porém as dificuldade que estou tendo é em fazer estes frameworks conversarem. É obrigatório que eu faça em Java e utilize Apache Storm, Kafka, Zookeeper e um gerador de Json. Futuramente irei converter para um hardware real, por isso os dados precisam vir de um g...
I'm using Kafka 2.6.0 with a sink connector to Postgres on Confluent Cloud. The issue I'm facing is due to extensive modifications to the default configurations for the sink connector. Key Points: - The primary issue I'm encountering is related to the configuration of the sink connector. - The connector is not functioning correctly, and data is not arriving in Postgres as expected. - I have made significant modifications to the default configurations for the sink connector. I need an expert who is proficient in Kafka, Confluent Cloud, and sink connector configuration to help debug and rectify the issue. You should be able to: - Analyze and troubleshoot the sink connector configuration to identify the root cause of the problem. - Make necessary amend...
I would like to establish the brand identity for So what is Do you know Strava - the online training platform? We would like to bring more life to the users strava feed, by enriching the users workout - and hopefully by our enrichment they'll receive more kudos. Kudos is similar to the facebook like - a thumbs up on the workout For this i need some basic brand guidelines: - Font types to be used - colors - Primary and secondary colors. - icon - logo - I think this should be like the icon but with the text "" 2 Logo with taglines - the same as above but with the taglines: - bring more kudos to your strava workouts - stand out in the strava feed I expect the user to clearly see that my service is related to strava, but it is not
...service that can help in calculating features for real-time streaming of stock tick data. This application needs to be proficient in: - Maintaining the full lifecycle of stocks for specific time periods like pre, trading, and closing per day. - Customizable day feature(calculate in startOfDay) and tick feature (calculate when tick comes in) real-time calculation. - High performance for calculating simultaneously. - An API that can serve all features for a specific stock for the current day for training input - Support for customizable trading logic triggering based on market snapshot features every N seconds. - Monitoring progress status (per day, and days) - support backtesting using mongodb data or kafka - better to be linux workable after simple switch since no r...
...storage services for data persistence and retrieval. - Implement best practices for error handling, retry mechanisms, caching, monitoring, and logging. - Ensure the application adheres to security best practices and website terms of service. - Collaborate with our development team to provide knowledge transfer and documentation. Requirements: - Strong experience in designing and architecting scalable web scraping solutions. - Proficiency in Node.js and familiarity with the NestJS framework. - Expertise in cloud technologies and services (AWS, Google Cloud, or Azure). - Knowledge of serverless architectures, containerization, and orchestration technologies like Kubernetes or Docker. - Experience with message queues and event-driven architectures (e.g., RabbitMQ, Apache Kafka...
...(Contract) Technical: Master's degree with 10 – 12 years related experience, of which at least 7 + years in development, 4+ years of product engineering experience Experience in Analytics and Business Intelligence is a plus Strong design and coding experience Expertise with the Go Lang platform or higher Experience with integration, data handling technologies and other open source frameworks such as Spring, Kafka, Elasticsearch, Solr etc Experience in NLP, Data Science and Text analysis is a plus. Good Knowledge for Python and GoLang. Experience in building event driven cloud native micro services architectures Experience in building ELK stack Hands on experience in Mongo, Redis, Cassendra, Neo4j, Postgres is a plus Experience with massive-sc...
About the company: 98thPercentile offers online, after-school, enrichment, and acceleration programs in Math, English (Reading & Writing), Coding, and Public Speaking for Grades K to 12 students. Our enrichment programs are designed to enhance the child’s overall academic development. Job Overview: We're on the lookout for freelance content writers to join our dynamic team and contribute to exciting projects. If you have a way with words and can deliver high-quality content across various niches, we want to hear from you! As an Freelance Content Writer, you will be responsible for creating engaging and informative Blogs aimed at students of various academic levels (Grades 1-12). We are looking for a passionate individual with a strong background...
...in full-stack technical development encompassing Java, Cloud, Web, UI, and mobile technologies, as well as exposure to Domain-Driven Design, Event-Based Architecture, API, and microservices architecture. The ideal candidate should possess a strong enthusiasm for emerging technologies and demonstrate a proficient understanding of various technologies spanning Cloud, UI, Application, Security, and Data architecture domains. Roles and Responsibilities:- • Your role will involve joining Fiserv's Global Issuer organization's Architecture team to lead the development of new cloud-native applications. Relevant experience in digital solutions within the payment solutions domain will be highly valued. • As the Lead Engineer, you will be expected to comprehend a w...
Looking for crash course on "Apache Kafka" Tutor
As a client, I'm seeking a Python developer who that can help me trasforming data. The primary source of the data will be company-related information. Ideal Skills and Experience: - Proficiency in Python - Extensive experience in data analysis, particularly with telecomdata - Familiarity with APIs for data collection - Knowledge of telecom - Ability to understand Python application and python scripts -Know about Airflow , Spark, Kafka, Transaction Mysql Key Requirements: - Develop a Python program that can efficiently trasform non useful to useful data. - Strong understanding of telecom data -Spark sessions, ETL ,Kafka, Mysql
I am in need of a professional who can help me in the data enrichment and cleaning of a set of merchant data. The data that requires the necessary cleansing and enhancing is primarily focused on merchant profiles. The main focus is on the verification process. Key tasks include: - Checking if the merchant meets our criteria list The ideal candidate for this project would have experience in data cleaning, enrichment, and verification. Your attention to detail and ability to cross-check,and verify data is crucial to the success of this project. Please share your relevant experience in your proposal and how you plan to approach this task. Your understanding of data quality and accuracy will be a major plus.
...companies alike. Over the years, we have built a large candidate pool in several industries, but in some cases, have lost touch with some candidates. As such, we have legacy candidate data – and this is where this project comes in! We will provide a specific list of legacy candidates, and we need assistance in someone calling the candidates on the list; confirming their details, and their current role and skills; identifying the industry or industries they can work in; and, hopefully, bringing them back to the organisation as an active candidate to place. The role will include: - Cold calling to candidate data provided based on the script provided - Gathering and confirming information based on the script provided - Updating the information in the sheet provided...
I want to improve the search function of a webshop. I want to do this by adding extra data to the products (in the form of tags). I have a list of 11,000 product names in Dutch. These product names consist of a piece of proper name, noun and then sometimes some content information. For example: Orange Cleaner degreaser 5L c We are looking for a quick way to see the noun plural in the column next to it. Also, one or more synonyms in the column(s) next to it would be nice. Example: degreasers (=plural) I understand this can be done with a Python script that performs these tasks. This script uses the Natural Language Toolkit (NLTK) library to identify multiples and synonyms. This script assumes you have a list of product names and want to find the plurals and synonyms for each of t...
...extensive experience in data migration across CRP, SIT, UAT, and GoLive phases in Oracle Fusion ERP implementation, utilizing ETL tools. * Experience in SQL Server, T-SQL, and SSIS Job Responsibilities: Data Extraction: * Extract data from various source systems, including flat files, spreadsheets, legacy databases, and external APIs. * Develop and optimize SQL queries and scripts for efficient data retrieval. Data Transformation: * Perform data cleansing, validation, and transformation to ensure data quality. * Convert data from source formats to Oracle-compatible formats. * Apply business rules and data mapping for aligning source data with target data structures. ETL Development: * Develop and maintain ETL (...
...of a Full-Stack developer well-versed in Apache Kafka for configuration, message serialization, deserialization, event streaming, and processing. Additionally, you will be responsible for developing Spring Boot microservices that encompass user authentication, authorization, database integration, data modeling, and REST API development. Key responsibilities include: - Kafka setup and configuration - Kafka message serialization and deserialization - Kafka event streaming and processing - Designing and implementing user authentication and authorization within Spring Boot - Integrating databases and modeling data effectively - Developing REST APIs with Spring Boot The ideal candidate for this project should have extensive experience with Kafk...
I need a Data Enrichment (Entry) Specialist to help me with a project. - I have text and categorical data which need to be further extracted from LinkedIn - The data has to be entered into a specific format or template which will be provided - You'll be required to extract data from LinkedIn for 200-400 leads per day Ideal candidates for this project should have: - Ability to maintain high confidentiality of the data - Proven experience with data entry and enrichment, especially text and categorical data - A keen eye for detail and high accuracy in data entry - Familiarity with LinkedIn and data extraction from the platform (Mandatory) - The ability to work with provided templates and formats - Excellent c...
I need a Node.js developer with expertise in transitioning a fully operating monolithic application to a microservices architecture using Kafka, Redis Server, and Openshift. A successful migration will preserve current functionalities including: - User profile management - Transactions processing - Content management The deadline is paramount, thus a professional with great time management skills is ideal. Prior experience in similar projects is highly desirable. Your expertise will ensure a seamless transition with zero interference to the current users.
I am aiming to add a depth of content to my current WordPress site, focusing specifically on integrating a dedicated section for electronics. Key Requirements: - Creation of a new 'Electronics' section on my website following the aesthetic and functionality of the site provided (). - Specifically, I want an emphasis on electronic components for circuits within this new category. Further details: - Particularly, I am looking to cover content about Resistors, Capacitors, and Diodes, electronic components. I have existing website, and I just need to re-do it so it will look like exactly like the link provided - Insightful descriptions, relevant images and specifications for these components should be included. Ideal Skills: - WordPress - Content Creation - Electronics - E-comm...
I am seeking a technically adept developer skilled in Java, Typescript, and Kafka for the purpose of integrating multiple technologies. This project is primarily focused on setting up a microservice architecture to efficiently process transactional data. Your responsibilities will include: - Developing robust Kafka producers and consumers to enable efficient data flow - Utilising your Java and Typescript expertise to build functional microservices Strong experience in Java, Typescript, Kafka, and microservice development is vital. An understanding of transactional data processing would be beneficial. Keen attention to detail, problem-solving skills, and a drive for tech integration efficiency are qualities sought for this project.
...understanding of B2B lead data to enrich/cleanup our current database. The focus of this project will be centered on company data & lead emails. The task's primary purpose is to find and add employee count to each company in the database. The secondary part of the task will involve matching the leads email to the company name. Some leads have multiple emails attached- We only need an email that corresponds to the company they work for. Attached is an image of the current data layout. There are 250,000 rows of data Ideal skills and experience for the job: • Extensive experience in data enrichment, preferably B2B lead data. • Understanding of different company sizes and ability to accurately categorize them. • ...
I am in need of a skilled R programmer with experience in Gene set enrichment analysis to assist me in analyzing proteomic data. The data is currently in tsv format, and is raw, requiring full preprocessing. Ideal skills and experience: - Advanced proficiency in R - Extensive experience in proteomics data analysis - Ability to clean and preprocess raw data - Familiarity with tsv file format - Strong understanding of gene set enrichment analysis - Analyze protein associations and pathways Your main tasks will be to preprocess the raw data, conduct gene set enrichment analysis, and provide me with a detailed report of the results. A strong background in proteomics is highly desirable.
I am looking for a skilled data engineer to assist with a project encompassing data ingestion and storage, transformation and processing, as well as ensuring adherence to data governance and compliance standards. Key Responsibilities: - Implementing real-time data streaming and batch data processing for the ingestion and storage of data. - Leveraging cloud-based data storage solutions, particularly within the Azure framework, to ensure scalability and reliability. Data governance and data protection Desired Outcomes: - Data transformation and processing should focus on efficient and effective data cleaning and normalization. - Further, data aggregation and summarization should help in deriving actionable ...
...Enhance board transparency: Introduce a new level of openness, with regular and clear communication about board decisions, activities, and financial matters. - Partnership with local businesses: Create strong and mutually beneficial relationships with local businesses to elevate our club’s stature and prospects. - Boost fundraising: Develop innovative fundraising strategies to support additional enrichment activities off ice for our members. An ideal candidate for this role should have similar experiences with leadership and business management. They should also understand the importance of transparency within board activities and have innovative ideas for fundraising. Your vote will play an important role in defining our collective path forward. I am a physician in my ar...
I'm in need of a proficient and detail-oriented writer to generate blog posts for my website, focusing on the health and care of small herbivores to add every other week to o...basic understanding of the nutritional needs and health concerns of small herbivores. The blog posts will cover a wide range of topics including: - General health of small herbivores particularly focusing on digestive issues, dental problems, and nutritional deficiencies. - Different aspects of diet and overall care i.e., recommended feeding guidelines, habitat setup, as well as exercise and enrichment activities. My aim is to improve the current resources available online and empower small herbivore pet owners with the information they need to provide the best care for their pets while building brand...
Descripción: ° Formación Académica: - Ingeniero en sistemas o Ingeniero en Software. ° Certificaciones: - Deseable: IT Architect. ° Sistemas Operativos: - Linux - Windows - 4 años de experiencia en desarrollo con: ° Front-End *Angular *React *html *css *javascript *typescript *grafana ° back-end *visual studio .NET *...Operativos: - Linux - Windows - 4 años de experiencia en desarrollo con: ° Front-End *Angular *React *html *css *javascript *typescript *grafana ° back-end *visual studio .NET *Java *Python *API Rest *Node.js *Php *Docker *Kubernet ° Oracle Developer *Forms y Reports *PL-SQL ° Bases de datos: - Oracle - SQL Server - PostgreSQL ° Servicios Web: - Web Services - Win Services - Reporting Servic...
Por favor, Cadastre-se ou Faça Login para ver os detalhes.
...stakeholders to gather and understand visualization and analytics requirements for the platform. • Design a comprehensive cloud-native architecture for the visualization and analytics platform, encompassing data ingestion, processing, storage, visualization, and analytics components. • Leverage your expertise to recommend open-source technologies, off-the-shelf software tools, or a combination of both to implement the chosen architecture. • Translate the overall architecture into a specific AWS cloud implementation plan. o Select appropriate AWS services for each component of the architecture (e.g., data storage, compute, analytics services, visualization tools). • Consider cost optimization strategies for the AWS cloud implementation • Identify an...
We are looking for a developer for a LONG TERM cooperation for a developer to participate in the product development PLEASE EXPLAIN IN YOUR ANSWER WHY YOU WOULD LIKE THIS OPPORTUNITY AND WHY YOU ARE A GOOD CANDIDATE FOR IT We would like to have excellent skills in - Angular (version 11+) - Java springboot - Ionic Mobile Apps - MySQL - Kafka Other good to have skillls - Understanding of e-commerce catalog & order data model - Payment provider integration - Bluetooth & POS printer connectivity - Java FX for desktop application - nice to have No agencies, please! Ideally, we would like a developer that would be able to dedicate 20 - 40 h per week, so it is ok to have another job too but 8h/day can be considered Must have - Excellent English / communication skills - ...
I am in need of a skilled sound designer to create a background score and sound effects that provide depth to the context of the visuals. The specifics of the visual content haven't been determined, but your role will be crucial in enhancing its narrative. Ideal candidates should have: - Profound understanding in sound editing - The ability to compose/add depth through sound - Reliability to deliver work ASAP This project offers the opportunity to shape the feel of the visuals through your creative sound design. If you are a reliable and passionate sound artist, I look forward to working with you.
...system that utilizes weather data provided by the Visual Crossing API. The project aims to process and analyze historical and current data to create weather forecasts for the next 26 days. The system will be built using TensorFlow in the Google Colab environment, which will allow for the use of cloud computing resources and facilitate the work on the project. Requirements: Integration with Visual Crossing API: Implementation of integration with the Visual Crossing API is required to retrieve weather data. The data should cover a wide range of information, such as temperature, precipitation, humidity, wind speed, atmospheric pressure, and more. Data Processing and Analysis: Weather data should be processed and prepared for analysis. Attention ...
...specializes in Kafka and Genesys system integration. The following is the tasks and main aim for this project: i) Deploy (Apache) Kafka on existing YTLC CES server and ensure it is compatible with the required Co-Browse version ii) Integrate Genesys Co browse to Kafka for it to send the Co-Browse Reporting Event to Kafka iii) Integrate Infomart to Kafka for it to extract data from the Kafka data stream and transforms it into the COBROWSE_FACTtable iv) To ensure / enable RAA to summarize and organizes the Info Martdata in ways that enable GI2 to extract meaning. v) To support required Custom Report template based on available reporting data field and ensure the required Co-browse reporting data appear in the GI2 Custo...
...specializes in Kafka and Genesys system integration. The following is the tasks and main aim for this project: i) Deploy (Apache) Kafka on existing YTLC CES server and ensure it is compatible with the required Co-Browse version ii) Integrate Genesys Co browse to Kafka for it to send the Co-Browse Reporting Event to Kafka iii) Integrate Infomart to Kafka for it to extract data from the Kafka data stream and transforms it into the COBROWSE_FACTtable iv) To ensure / enable RAA to summarize and organizes the Info Martdata in ways that enable GI2 to extract meaning. v) To support required Custom Report template based on available reporting data field and ensure the required Co-browse reporting data appear in the GI2 Custo...
I am looking for a skilled developer experienced in Spring Boot, Kubernetes, Dockers, Kafka, and AWS deployment to build a microservices app. This project requires: - User Authentication: The app should be able to handle user signup, login, password recovery, and security checks. - Data Processing: Facilitating data collection, organization, processing, and efficient management. - Third Party Service Integration: Seamless interoperability with other external applications or systems for enhanced functionality. The app is geared towards the general public and business-to-consumer (B2C). It is therefore essential that the app is user-friendly and aligns to the best industry practices for B2C applications. The ideal freelancer should have a proven track record in de...
We require a highly skilled Kafka expert with deep expertise on real production environments. We want to have a high available solution which is also fail tolerant to destination processing systems Strong expertise on Kafka and how to read data from one system, parse this data reliably with options to debug later and finally post data to the destination system What is not required: - HA solutions of kafka - high load - failsave Budget? will not be disclosed, place your best bid to get considered What is next? We will share you a NDA and afterwards a paid test task. Payment? - you estimate in a WBS (optimistic, expected, pessimistic, where optimistic < expected < pessimistic) after getting the task - we discuss about cle...
For this task, I require a skilled developer with solid background in Docker and Kafka. The task at hand is to work on an existing Docker Compose script for a Kafka application centered around authorization. Key Requirements: - Incorporating SASL/SCRAM authentication mechanism. - Focusing on the SCRAM-SHA-256 version for Kafka authentication. A deep understanding of the listed technologies and profound experience in adding security features to Kafka applications will be a significant advantage. Secure, reliable streaming is the goal. Therefore, the freelancer needs to be knowledgeable about how SASL/SCRAM authentication enhances Kafka application's security. Only bid if you are highly confident you can deliver my exact requirement.
*Title: Freelance Data Engineer* *Description:* We are seeking a talented freelance data engineer to join our team on a project basis. The ideal candidate will have a strong background in data engineering, with expertise in designing, implementing, and maintaining data pipelines and infrastructure. You will work closely with our data scientists and analysts to ensure the smooth flow of data from various sources to our data warehouse, and to support the development of analytics and machine learning solutions. This is a remote position with flexible hours. *Responsibilities:* - Design, build, and maintain scalable and efficient data pipelines to collect, process, and store large volumes of data from diverse sources. - Collabora...
I need a Airflow expert to help redesign my data flow and put in place a solution that is scalable and can account for future needs. Our basic flow is making API calls to third-party solutions and getting data for various customers. This requires using the right API keys for each customer. The data will then be put in a Kafka queue for further processing. I am looking for someone with experience to help think through and implement solutions.
...am looking for a skilled developer proficient in Apache Camel, Spring Boot, Kafka, and Ksqldb. The goal is to integrate Salesforce, ERP, and SAP using a cloud to cloud rest api approach. The successful applicant will have extensive experience leveraging these technologies to implement both staging and production deployment. Key Responsibilities: - Build a middleware solution for cloud to cloud rest api integration. - Ensure this solution adheres to best practice for handling transactions. Specifics: - An existing REST API for the Salesforce integration is present. - The Salesforce integration needs to support order management functionality. Ideal Skills: - In-depth knowledge of Apache Camel, Spring Boot, Kafka, Ksqldb. - Prior experience with Salesforce, ERP, and ...
...(IngressRouteTCP). The primary goal for this project is to leverage these components for efficient routing and connecting on kafka from external port 9093 or 9094 by hostname. Example client command: "kcat -b -L -J" I have already independently deployed a Minikube cluster with Strimzi and Traeffik, everything works fine inside the cluster, but to connect from the outside you need to connect via kafka :cluster-ip, and I can't do it. I know how to create self-signed certificates and a trusted certificate authority, so it shouldn't be difficult to quickly generate and and Key Responsibilities: - Configurate strimzi kafka :cluster-ip and tls:true - Configurate traefik kind: IngressRouteTCP - Configurate TLS self signed certificate
Por favor, Cadastre-se ou Faça Login para ver os detalhes.
...aims to develop a multi-platform e-commerce application that provides a seamless shopping experience for users across web and mobile platforms. The application will offer a wide range of products, facilitate secure payments, and ensure efficient order processing and fulfillment. Key Features: User Authentication and Authorization: Implement user authentication using JWT tokens and secure user data storage in MongoDB or Firestore. Utilize C# with ASP.NET Core for backend APIs handling user registration, login, and authorization. Product Catalog and Search: Develop a robust product catalog using PostgreSQL or MySQL for storing product information. Implement search functionality using Elasticsearch for fast and efficient product discovery. Frontend Development: Build the web ap...
I’m in pressing need of an SEO professional to enrich my SquareSpace website. The aim is to dramatically improve online visibility. Here’s what you need to know: - Among my extensive product portfolio, over 500 products are in dire need of SEO adjustments. This includes SEO tags and SEO descriptions. - While some SEO tags and descriptions are already prepared, development will be necessary for a considerable number of items. Ideal freelancer skills: - Solid SEO background - Competency in SquareSpace platform - Experience with e-commerce SEO Now, I am relying on your expertise to help enhance my online visibility and consequently drive my business forward.
...of expert help with Apache Kafka and Genesys Infomart Co-browse, specifically, to seamless integrate them with SAP Business Intelligence (BI). Key features I want to be embedded on this project are: - Real-time data streaming - Data synchronization - Highly customizable data filters The kind of data that should be extracted from SAP BI and used for analysis on Apache Kafka and Genesys Infomart encompasses: - Customer interactions data - Operational data To be an excellent fit for this job, ideal candidates should possess: - Proficiency in Apache Kafka and Genesys Infomart - Extensive experience in SAP Business Intelligence (BI) - Solid background in data synchronization and creating adjustab...
...integration support between Apache Kafka and Genesys Infomart Co-browse Reporting Metrics. The primary goal is to make Genesys Engage platform Co-Browse session report data available. A couple of things to note about this job: - Strict Timeline: The project has a specific timeline that must be adhered to. The chosen candidate should be capable of time management and maintaining strict project deadlines. - Skills Required: In-depth knowledge and working experience in using Apache Kafka & Genesys Infomart is crucial for the successful implementation of this project. Applicants must be prepared to demonstrate their expertise in these areas for consideration. - Additional Expertise: There will be a need for additional specific expertise beyond Apache Kafka ...
