Kafka Admin/Developer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Kafka Admin/Developer responsible for installing, configuring, and maintaining Apache Kafka clusters in cloud and hybrid environments. Collaborating on integration patterns and ensuring high availability and disaster recovery processes.
Responsibilities:
- Install, configure, and maintain Apache Kafka clusters in cloud and hybrid environments.
- Manage Kafka brokers, ZooKeeper / KRaft, topics, partitions, and replication.
- Monitor cluster health, throughput, latency, and availability.
- Perform capacity planning, upgrades, patching, and performance tuning.
- Implement high availability and disaster recovery strategies.
- Design and develop event-driven architectures using Kafka.
- Build and maintain Kafka producers and consumers.
- Implement Kafka Streams / ksqlDB for real-time data processing.
- Develop and manage Kafka Connect connectors for source and sink systems.
- Ensure schema management using Schema Registry (Avro, JSON, Protobuf).
- Implement Kafka security features including SSL/TLS, SASL, and ACLs.
- Enforce data encryption in transit and at rest.
- Integrate Kafka with IAM and enterprise authentication systems.
- Support compliance with HIPAA, CMS, FISMA, FedRAMP, and NIST standards.
- Assist with audits, security documentation, and ATO processes.
- Integrate Kafka streams with API Gateways (e.g., MuleSoft).
- Support near real-time data feeds for fraud detection and analytics platforms.
- Collaborate with API developers and data architects on integration patterns.
- Ensure reliable data delivery and message ordering.
- Integrate with existing monitoring and alerting tools like Splunk, New Relic, Grafana, ELK, or Confluent Control Center.
- Troubleshoot production issues and perform root cause analysis.
- Support incident response and on-call rotations.
- Document configurations, processes, and operational runbooks.
- Work closely with DevSecOps, data engineering, QA, and security teams.
- Participate in Agile ceremonies and release planning.
- Provide technical guidance and best practices for streaming solutions.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
- 4+ years of experience with Confluent Kafka administration and development.
- Hands-on experience with Kafka Connect, Kafka Streams, and Schema Registry.
- Experience with cloud platforms (AWS MSK, Confluent Cloud, Azure Event Hubs for Kafka).
- Strong Linux and scripting skills (Bash, Python).
Similar Jobs
React Native Mobile Developer
React Native Mobile Developer building iOS/Android apps for clients' initiatives. Collaborating with engineers and cross-functional teams to craft optimal user experiences.
React Native Developer, TypeScript
React Native App Development Intern working with engineering team to develop mobile applications. Collaborating on real projects within a startup environment based in India.
Polyglot Developer, 5-10 years
Polyglot Developer designing and implementing software architectures across programming languages. Collaborating with teams to build scalable, high-performance applications in a remote capacity.
COBOL Developer
COBOL Developers modernizing legacy applications into SQL/MX within HPE NonStop environment. Focus on code quality, analysis, and system reliability.
Director, Project Engineering
Director of Project Engineering at DSV managing construction and technology deployments. Leading project engineering group and overseeing implementations of new facilities and technologies.
Healthcare EiPaaS Developer
EiPaaS Developer managing Bridgegate operations and electronic file processing within a healthcare company. Ensuring compliance and overseeing workflows related to electronic files.
System Developer
Systems Developer developing customized solutions for supply chains. Working independently and collaboratively to improve supply chain efficiency.
Mainframe Developer, COBOL
Desenvolvedor Alta Plataforma trabalhando para uma das maiores instituições financeiras públicas do país. Apoiará no desenvolvimento e segurança das políticas públicas e sociais.
Flutter Developer, Mid-Level
Flutter Developer for digital transformation initiatives at FCamara. Collaborate in agile teams to enhance technology solutions and create high-quality user experiences.
Senior Developer Analyst
Analista Desenvolvedor SR focusing on innovative Java solutions at Hitss. Involved in developing high-performance applications and implementing microservices.
Survey Programmer
Survey Programmer at MarketOnce programming online surveys and analyzing data for client deliverables. Collaborating with clients to ensure high-quality survey experiences and structuring datasets in SPSS and Excel.
Lead Developer
.Net Lead Developer working remotely with Back End .NET and Front End Blazor frameworks. Implementing Gen AI tools like GitHub Copilot.
Flutter Developer
Senior Flutter Developer at MED Review responsible for application development using Flutter and Dart. Ensuring technical quality, stability, and performance in a collaborative and agile environment.
Developer, Data Integrator
Data integration developer at TEHORA designing and maintaining data processes and interfaces. Collaborating on data architectures and ensuring data quality and performance.
Junior Developer Analyst
Junior Developer at Minsait working on low-complexity tasks using Python, Scala, and SQL. Involved in ETL processes and creating data visualizations with dashboards for clients.
Senior UKG Pro, Boomi Developer
Senior UKG Pro Boomi Developer designing and supporting integrations for UKG Workforce Management applications. Collaborating with stakeholders to deliver scalable and secure solutions.
WordPress Developer
WordPress Developer responsible for architecting and maintaining delivery frameworks for websites. Collaborating with teams to optimize site applications in a full-service DevOps agency.
Senior iOS Developer
IOS Developer Mobile Sênior developing native iOS applications with a focus on quality and user experience. Collaborating with product and design teams and implementing new features.
Senior Technical Developer
Senior Technical Developer maintaining enterprise project controls platform by building full-stack system features. Collaborating on machine learning infrastructure with a focus on TypeScript and React.
Manager of Engineering
Engineering Manager at EverHealth leading healthcare technology initiatives and managing engineering teams. Rediscovering the health IT industry with a focus on delivering high-quality software solutions.