Kafka Integration Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Part-time Kafka Integration Engineer building Kafka-to-API integrations for Captain Up. Deploying secure, scalable data pipelines with Kubernetes, Helm, and AWS.
Responsibilities:
- Lead and execute data integration initiatives between customers’ Kafka streams and internal APIs
- Design, build, and maintain Kafka consumers to ingest and batch-process customer event data
- Implement message parsing and transformation logic using JSON, Avro, and Protobuf
- Develop and configure provider-specific customer integrations
- Manage secure credentials using AWS Secrets Manager and handle per-application configurations
- Deploy and monitor services in Kubernetes using Helm
- Collaborate with DevOps to troubleshoot deployments, monitor performance, and ensure system reliability
- Work directly with customers’ engineering teams to design, build, troubleshoot, and own integrations end-to-end
- Collaborate with internal DevOps to build scalable, efficient, and secure data pipelines
Requirements:
- Proficient in Node.js and TypeScript
- Strong experience with Apache Kafka and libraries like KafkaJS or similar
- Hands-on experience designing and consuming REST/HTTP APIs for service-to-service integration
- Solid working knowledge of SQL and/or NoSQL databases, including schema design, queries, and indexing for high-throughput pipelines
- Familiarity with message schemas such as Avro and Protobuf and relevant parsing libraries
- Hands-on experience with Kubernetes, Helm, and AWS services, especially Secrets Manager
- Hands-on experience using AI coding assistants such as Claude / Claude Code, Cursor, Copilot, or similar
- Confidence, professionalism, and proactivity in customer communication via calls, Slack, email, and screen-shares
- Excellent spoken and written English (C1+ / fluent)
- Ability to write robust, testable, and maintainable code for high-throughput and low-latency data pipelines
- Excellent debugging, problem-solving, and communication skills
Similar Jobs
Senior MarTech Solutions Engineer
Senior MarTech engineer building AI agents, Adobe integrations, and full-stack marketing automation solutions for Nortal's global enterprise clients. Remote across LATAM.
Solutions Engineer
Solutions Engineer helping credit unions deploy Eltropy's AI communications platform. Designing integrations, supporting pre-sales, and guiding SaaS implementations.
Solutions Architect
Solutions Architect advancing Axiad Mesh, an identity-risk decision platform. Leading demos, proof-of-value engagements, and technical deal strategy for cybersecurity customers.
Senior Solutions Consultant – Speciality
Senior Solutions Consultant leading enterprise healthcare technology discovery, solution design, demonstrations, and deal strategy for Cencora. Mentoring consultants and influencing product direction.
Senior Solutions Consultant – Infusion
Senior Solutions Consultant leading healthcare technology pre-sales, solution design, and enterprise deal strategy for Cencora customers. Advising healthcare organizations while influencing products and mentoring consulting teams.
Databricks Solution Architect
Databricks Solution Architect leading Clearstead’s financial advisory data and AI platform. Designing Azure Databricks architecture, production pipelines, and AI infrastructure.
Senior Solutions Architect, AI Factory Infrastructure
Senior Solutions Architect mapping customer workloads to NVIDIA AI factory architectures. Designing scalable data-center solutions and driving technical adoption with customers and partners.
Senior Solutions Engineer – Tax
Senior Solutions Engineer demonstrating insightsoftware’s Longview Tax solution to clients and partners. Translating direct-tax requirements into tailored demos, POCs, proposals, and RFP responses.
Senior Solutions Engineer
Senior Solutions Engineer enabling Twilio’s communications products through technical pre-sales in the UK. Leading discovery, architectures, demonstrations, and API-based customer solutions.
Solutions Architect
Solutions Architect designing secure enterprise cloud architectures for Weekday’s client. Leading presales, integrations, deployment strategies, and technology governance.
Data Integration Engineer, Databricks, Python, SQL
Data Integration Engineer building Databricks, Python, and SQL integrations for a Big4 consultancy’s AI-driven KYC platform. Ensuring reliable data models, contracts, APIs, and quality controls.
IT Solution Architect – Azure, Databricks, AI Platforms
IT Solution Architect designing production Azure and Databricks architectures for AI-driven KYC platforms. Supporting financial institutions with integrations, resilience, operations, and service transition.
Senior SAP Commerce Cloud – Solutions Architect
Arquiteto de soluções SAP Commerce Cloud modernizando plataformas de e-commerce da Keyrus. Liderança técnica de arquiteturas escaláveis, integrações corporativas e ambientes cloud.
Data Integration Engineer
Data Integration Engineer building Python and SQL healthcare transaction pipelines for an episode-based benefits startup. Integrating claims, enrollment, provider, and partner data into core systems.
Principal Solution Architect – ServiceNow
Principal Solution Architect designing ServiceNow enterprise architectures for Canadian customers. Advising technology executives on AI, cloud platforms, integrations, and digital transformation.
Solutions Engineer
Solutions Engineer delivering German and English demos for Qargo’s cloud-based transport management platform. Translating logistics customer needs into technical solutions and product feedback.
Senior Solutions Engineer – Systems Integration, BESS
Senior Solutions Engineer integrating BESS subsystems for AES, a global power company. Leading system architecture, compliance, deployment support, and field troubleshooting.
JD Edwards Homebuilder Solution Architect
JD Edwards Homebuilder Solution Architect designing scalable ERP solutions for ERP Suites’ homebuilding clients. Leading discovery, presales, implementation guidance, and delivery architecture.
Solution Architect – JDE
Solution Architect designing JD Edwards and integrated enterprise solutions for consulting clients. Leading discovery, presales architecture, implementation guidance, and delivery oversight.
Marketing Automation Solutions Architect – Temp Contractor
Marketing automation architect maintaining Credible’s email platforms, data flows, and compliance-critical programs. Supporting a U.S. consumer finance marketplace during a 3–6 month team-leave coverage period.