Kafka Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Kafka Engineer responsible for Apache Kafka cluster development and administration. Supporting high-volume data streaming and real-time data integration for complex enterprise systems.
Responsibilities:
- Design, build, administer, and maintain Kafka clusters across development, test, and production environments.
- Manage Kafka topics, partitions, brokers, replication, retention policies, and access controls.
- Monitor Kafka performance, availability, throughput, and latency; proactively identify and resolve issues.
- Perform capacity planning, tuning, upgrades, patching, and disaster recovery planning for Kafka environments.
- Implement and maintain high availability and fault-tolerant Kafka configurations.
- Develop and support event streaming pipelines using Kafka for real-time and near-real-time data processing.
- Integrate Kafka with API Gateway (APIGW)–based microservices and downstream backend systems.
- Design and implement Kafka producers, consumers, and connectors (e.g., Kafka Connect) to support system integrations and ETL/data movement needs.
- Collaborate with application teams to define event schemas, topics, and data contracts.
- Ensure reliable message delivery, data integrity, and error handling across streaming workflows.
- Implement Kafka security best practices, including authentication, authorization, encryption in transit, and auditing.
- Ensure Kafka implementations comply with CMS security, data governance, and operational standards.
- Support DevSecOps practices, CI/CD pipelines, and infrastructure-as-code approaches where applicable.
- Participate in incident response, root cause analysis, and operational readiness activities.
- Work closely with architects, developers, DevOps engineers, and system administrators to support solution design and delivery.
- Document Kafka architectures, configurations, operational procedures, and integration patterns.
- Provide technical guidance, troubleshooting support, and knowledge transfer to internal teams.
Requirements:
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- 3+ years of experience developing, administering, and supporting Apache Kafka in enterprise environments.
- Hands-on experience managing Kafka clusters, topics, partitions, and event streaming pipelines.
- Experience integrating Kafka with microservices, API Gateways (APIGW), and backend systems.
- Strong understanding of event-driven architectures, messaging patterns, and data streaming concepts.
- Experience with Linux-based environments and command-line administration.
- Strong troubleshooting and performance tuning skills.
- Ability to clearly communicate technical concepts to both technical and non-technical stakeholders.
Similar Jobs
Service Desk Engineer
Service Desk Engineer providing premium IT support for a portfolio of high-profile clients across Mac and Windows. Primarily remote, with occasional client site visits in London.
Support Escalation Engineer
Windows Support Engineer ensuring flawless technology operation and client satisfaction at My IT Crew. Troubleshooting Microsoft technologies and building client relationships in a remote work environment.
Associate Wireless & Networking Engineer
Associate Wireless & Network Engineer role involves supporting enterprise wireless solutions at TIEVA. Collaborates with senior consultants for design, implementation, and network support.
Senior Middleware Engineer
Senior Middleware Engineer leading messaging and integration platforms including RabbitMQ and Redis. Collaborating with DevOps and development teams to deliver resilient solutions across the organization.
Senior Mining Engineer
Senior Mining Engineer providing technical direction and support for solid minerals development at Flatwater Group. Involves leadership, grant monitoring, and mining project evaluations.
Senior Mining Engineer
Senior Mining Engineer leading technical direction and advising on solid minerals development at Flatwater, Inc. Overseeing mine planning and grant evaluations for resource development.
Biomedical Engineer – Software Systems
Biomedical Engineer developing software systems supporting full life cycle of software applications at Arthrex, a global medical device leader.
IAM Engineer
IAM Engineer managing enterprise identity and access platform modernization for a global consulting company. Responsible for technical implementation across diverse environments.
Equipment Engineer
Installation mechanic for lifts with Otis, ensuring high quality and safety standards during installations. Join a global leader in the elevator and escalator manufacturing and service industry.
Electrical Engineer – Power and Distribution Networks
Engineer for electrical supply networks at netzkontor nord gmbh, planning and developing future energy infrastructures. Collaborating with clients on electric supply networks, renewable energy integration, and innovative solutions.
Senior Privileged Access Management Engineer
Senior Privileged Access Management Engineer managing PAM capabilities for Republic Services and leading technical guidance for enterprise security solutions.
Journeyman Marine Propulsion Engineer
Journeyman Marine Propulsion Engineer supporting US Coast Guard with marine vessel design and evaluation. Involves system inspections, technical reviews, and engineering analysis at AMERICAN SYSTEMS.
Engineer I, SOC
Entry-level Engineer I position in security operations at NextGen Healthcare. Collaborate on security processes and tools while gaining experience in a supportive environment.
Identity Management Engineer
Identity Management Engineer supporting GDIT's healthcare systems, focusing on Oracle Identity Management applications and IAM processes. Involved in identity monitoring, user provisioning, and system documentation.
Senior Genesys Telecom Engineer
Senior Telecom Engineer developing and maintaining Genesys Cloud CX solutions. Collaborating with teams to enhance customer and employee engagement in ComPsych's contact center.
Senior Release Train Engineer
Senior Release Train Engineer leading SAFe Agile Release Train supporting federal programs. Facilitating Agile practices and ensuring compliance with federal governance and security requirements.
Senior Asset Engineer
Asset Engineer managing natural gas and water systems planning with a focus on hydraulic modeling and infrastructure scoping. Joining EQT's collaborative team to drive growth initiatives.
EUC Engineer
EUC Engineer focusing on imaging and deployment with expertise in Microsoft Intune and Windows environments. Managing hardware support and endpoint management for enterprise devices remotely.
SailPoint Engineer
SailPoint Engineer tasked with architecting and overseeing onboarding solutions for enterprise applications using SailPoint ISC. Collaborating with multiple teams to ensure compliance and governance in identity security.
Ingénieur d'affaires
Business Engineer promoting Viessmann's climate and energy solutions in France to key accounts and installers. Responsible for driving sales and client project support.