Staff Infrastructure Engineer – Data Streaming
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Staff Infrastructure Engineer operating massive-scale Kafka and Redis data platforms for SentinelOne’s AI-native cybersecurity platform. Building portable, automated infrastructure across Kubernetes, multi-cloud, and air-gapped environments.
Responsibilities:
- Lead the design and operation of distributed data services, including self-hosted Kafka and Redis, across Kubernetes clusters and multi-cloud environments
- Build automated, self-service infrastructure across AWS, GCP, and air-gapped on-premises environments
- Manage data infrastructure supporting 5 or more PB/day ingestion with low-latency, high-throughput, cost-effective operation
- Consolidate and optimize multi-tenant Kafka clusters
- Drive Redis and Kafka lifecycle automation using GitOps principles, ArgoCD, and Terraform
- Define and implement observability, high availability, backup, and disaster recovery standards for stateful Kubernetes workloads
- Partner with FinOps and engineering stakeholders to optimize performance, cost, and operational overhead
- Own the end-to-end platform experience for mission-critical open-source systems serving hundreds of product teams
- Collaborate with teams in Europe and India using Kubernetes, Jenkins, GitHub Actions, ArgoCD, and Terraform
Requirements:
- 8 or more years of experience in infrastructure/platform engineering
- Proven track record operating stateful distributed systems at scale
- Deep hands-on experience with self-hosted Kafka and Redis in Kubernetes, including performance tuning, scaling, partitioning, persistence, and operator-based lifecycle management
- Strong understanding of Kubernetes internals and production management of stateless and stateful workloads
- Experience providing Database- or Messaging-as-a-Service (DBaaS/PaaS)
- Exposure to multi-cloud environments with strong expertise in AWS, GCP, or Azure
- Experience with Infrastructure as Code and GitOps practices, including Terraform, ArgoCD, or Pulumi
- Familiarity with blue-green, canary, and rolling deployment strategies
- Strong scripting or development skills such as Python or Go
- Solid understanding of CI/CD pipelines and workflow automation
- U.S. Citizenship required
- FedRAMP staff may be subject to customer or third-party background checks up to and including Secret Clearance if required by the role
Benefits:
- Restricted Stock Units (RSUs)
- Employee Stock Purchase Plan (ESPP)
- Flexible time off
- Paid company holidays and paid sick time
- Gender-neutral parental leave
- Grandparent leave
- Medical, dental, and vision coverage
- 401(k) retirement plan with company match
- Life and disability insurance
- Health and dependent care FSA
- Voluntary benefits (hospital, accident, critical illness)
- Employee Assistance Program (EAP)
- ARAG pre-paid legal
- Nationwide pet insurance
- Cancer Care program
- Global business travel medical insurance
- Home office allowance
- Mobile phone reimbursement
- Wellness coach
- Wellness/gym reimbursement
- Fertility coverage
- Adoption & surrogacy reimbursement
Similar Jobs
AWS Data Engineer
AWS Data Engineer joining Devoteam, a European digital strategy and technology consultancy. Building AWS data solutions with Spark, Python, SQL, Airflow, Docker, and ECS from Spain.
Lead Data Engineer
Lead data architecture and transformation for Fortune 500 insurance clients. Owning enterprise data platforms, delivery teams, stakeholder alignment, and governance through go-live.
SAP BODS, Data Migration Manager
SAP data migration manager leading SAP S/4HANA transformation programs for enterprise clients. Managing BODS-driven migrations, governance, data quality, and cross-functional delivery teams.
Data Engineer
Data Engineer designing SQL Server data models and ETL systems for Analytica’s U.S. government technology programs. Deploying analytics applications and models through CI/CD in agile client teams.
Senior Data Engineer
Senior Data Engineer modernizing PDMI’s pharmacy data platforms with AWS, Redshift, ETL, and Tableau. Building governed pipelines, warehouses, and analytics solutions for healthcare reporting.
Data Engineer II
Data Engineer II building scalable data pipelines and self-serve platforms for Slate’s affordable electric vehicles. Supporting analytics, machine learning, and critical business decisions.
Senior Data Engineer
Engenheiro de Dados Sr desenvolvendo IA, pipelines e infraestrutura para projetos tecnológicos da Spassu. Otimizando dados, bancos e integrações em larga escala.
Senior Data Engineer
Engenheiro de Dados SR projetando arquiteturas modernas e pipelines escaláveis para a Triggo.ai, empresa brasileira de Analytics, IA e transformação digital.
Senior Data Engineer
Senior Data Engineer building automated payments reporting and analytics for SPD Technology’s client. Designing cloud data pipelines, financial data models, and KPI dashboards for trusted variance analysis.
Senior Data Engineer
Senior Data Engineer building AWS ETL/ELT pipelines and dbt models for Tango’s cloud real-estate and facilities SaaS. Managing databases, data quality, warehousing, and observability.
Senior Data Engineer
Senior Data Engineer building AWS and dbt data pipelines for Tango’s cloud real-estate and facilities SaaS platform. Managing databases, warehouses, data quality, and analytics-ready datasets.
Senior Azure Data Architect
Senior Azure Data Architect developing predictive HR solutions for the U.S. Marine Corps. Leading data strategy, machine learning models, Azure deployment, and data science teams.
Azure Data Architect
Azure Data Architect developing predictive models and Azure data solutions for Sparibis's HR and defense projects. Leading data science strategy, governance, visualization, and team mentorship.
Senior Data Engineer
Senior Data Engineer productionizing cyber-risk data products for Asian-market insurance brokers. Building Python/Airflow pipelines, PostgreSQL systems, and GraphQL data services in a remote LATAM team.
Staff Engineer – Data Modeler
Staff Data Modeler designing secure unstructured-knowledge data products for Nagarro, a digital product engineering company. Governing metadata, domains, and Unity Catalog registration for KM platforms.
Senior Data Engineer, Finance
Senior Data Engineer owning finance data pipelines and models for Instacart, a grocery delivery platform. Supporting accounting, billing, revenue, and financial reporting at scale.
Ingeniero de Datos
Ingeniero de datos en TP, líder mundial en gestión omnicanal de experiencia del cliente. Garantizando calidad de datos, optimizando SQL y apoyando reportes y nómina.
Senior Architect, Licensed Building Architect, Data Centers
Licensed architect leading hyperscale cloud and colocation data center design for AECOM, a global infrastructure consulting firm. Guiding projects from concept through construction closeout.
Senior Architect, Licensed Building Architect, Data Centers
Licensed architect leading hyperscale and colocation data center projects for AECOM, a global infrastructure consulting firm. Developing secure, scalable facilities from concept through construction closeout while coordinating multidisciplinary teams and clients.
Senior Architect, Licensed Building Architect, Data Centers
Lead architect designing hyperscale cloud and colocation data centers for AECOM, a global infrastructure consulting firm. Guiding integrated design, construction administration, compliance, and client delivery across complex mission-critical projects.