Principal Site Reliability Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Principal SRE ensuring reliable cloud infrastructure for Tandem Diabetes Care’s insulin technology. Leading incident response, automation, disaster recovery, and compliance across distributed teams.
Responsibilities:
- Lead day-to-day production support, including intake, triage, prioritization, escalation, queue health, and change execution
- Establish consistent support practices across a distributed team, including shift handoffs, ticket quality standards, and ownership of open issues
- Lead incident management end-to-end, including incident command, stakeholder communication, and blameless postmortems with corrective actions tracked to closure
- Coordinate production security incident response with Security teams
- Own on-call strategy, rotation design, escalation paths, alert tuning, and tooling such as PagerDuty and New Relic
- Serve as a senior escalation tier for high-severity incidents
- Build runbooks for common failure modes and first-line resolution
- Define and own SLIs and SLOs for critical services
- Reduce MTTD and MTTR through instrumentation, alerting, diagnostics, and automation
- Convert recurring support burden into permanent fixes, automation, or documentation
- Maintain technology currency and lifecycle management for cloud services, Kubernetes clusters, operating systems, runtimes, and infrastructure components
- Own business continuity and disaster recovery readiness, including backup and recovery strategies, recovery testing, failover capabilities, recovery runbooks, and RTO/RPO objectives
- Lead infrastructure automation with Terraform
- Eliminate toil through automation
- Add reliability guardrails to CI/CD pipelines, including automated rollback, change-risk checks, and progressive delivery
- Maintain production systems in accordance with regulatory and compliance requirements
- Maintain business continuity and disaster recovery documentation and audit evidence
- Partner with Security, Quality, and Compliance teams on audits, compliance, and remediation
- Grow SRE and DevOps engineers through pairing, design and code review, and incident debriefs
- Foster open communication among junior and contract engineers
- Communicate documentation-first across distributed, multi-time-zone teams
- Partner with software engineering, QA, and architecture to embed reliability into the development lifecycle
- Inform capacity planning and scaling strategy with the Test team
- Introduce proactive resilience testing such as game days
- Align business continuity and disaster recovery capabilities with application requirements
- Support cloud cost optimization through rightsizing, reserved capacity, and observability spend governance
- Ensure work complies with company policies and applicable Privacy/HIPAA, regulatory, legal, and safety requirements
Requirements:
- Demonstrated experience leading production support and incident management for production systems, including incident command during high-severity events
- Strong grounding in SRE principles, including SLIs/SLOs, blameless postmortems, toil reduction, and reliability engineering
- Demonstrated experience owning on-call strategy, including rotation design, alert tuning, and escalation
- Expertise with Terraform or comparable IaC at scale, including module design, state management, and policy-as-code guardrails
- Hands-on experience building CI/CD pipelines with reliability guardrails using GitHub Actions, Octopus Deploy, or Azure DevOps
- Deep experience with at least one major cloud platform: AWS, Azure, or GCP
- Experience with Docker and Kubernetes
- Working knowledge of observability tooling such as Prometheus, Grafana, Datadog, CloudWatch, and ELK/OpenSearch
- Experience designing and testing disaster recovery, including backup/restore, failover, and RTO/RPO validation
- Working knowledge of cloud security and compliance practices, including IAM, network segmentation, encryption, vulnerability and patch management, and cloud cost optimization
- Proficiency in at least one scripting or programming language such as Python, Go, or Bash
- Experience in FDA and ISO regulated industries and agile methodologies preferred
- B.S. in Computer Science or equivalent combination of education and applicable job experience, including technical school training and certifications in networks, servers, and cloud infrastructure; demonstrated production experience weighs more heavily than degree
- Relevant cloud certifications such as AWS/Azure/GCP Professional or Architect level preferred
- 10+ years in Site Reliability Engineering, DevOps, or infrastructure engineering
- 2+ years mentoring or technically leading other engineers, including remote, offshore, or contracted partner engineers
- Must be within the United States
- Successful completion of pre-employment drug test and background check
- Compliance with applicable company, Privacy/HIPAA, regulatory, legal, and safety requirements
Benefits:
- Medical, dental, and vision benefits available the first day
- Health savings accounts
- Flexible savings accounts
- 11 paid holidays per year
- Minimum of 20 days of paid time off, with accrual starting on day 1
- 401(k) plan with company match
- Employee Stock Purchase plan
- Equipment provided
- Virtual training
- Bonus and competitive compensation package
- Joy-focused workplace supporting well-being, achievement, growth, fun, and camaraderie
Similar Jobs
Lead DevOps Engineer
Lead DevOps Engineer leading cloud infrastructure, CI/CD, and security for Octus, a global credit intelligence and analytics provider. Mentoring DevOps engineers and ensuring reliable, scalable systems.
DevOps Engineering Manager
Engineering Manager leading Platform & Cloud Operations at Creatio, an AI CRM and workflow platform. Driving CI reliability, cloud availability, release quality, and engineering team effectiveness.
DevOps Engineering Manager
Engineering Manager leading Platform & Cloud Operations for Creatio’s AI CRM platform. Managing four teams responsible for CI, cloud reliability, release upgrades, and internal developer tooling.
DevSecOps Engineer
DevSecOps Engineer building secure, scalable cloud platforms for EX Squared LATAM. Automating CI/CD, infrastructure, and security practices across software delivery.
Security Consultant – Penetration Testing, DevSecOps
Security Consultant conducting application, API, cloud, and infrastructure penetration testing for Capgemini’s technology transformation services. Embedding security controls across DevSecOps pipelines and the software development lifecycle.
Senior Observability/DevOps Engineer
Senior Observability/DevOps Engineer migrating enterprise Datadog monitoring platforms for global IT services company. Automating observability across AWS and Kubernetes using Terraform and Datadog APIs.
Senior DevOps Engineer
Senior DevOps Engineer leading enterprise GitHub repository and CI/CD migrations for Miratech, a global IT services and consulting company. Automating platforms across GitHub, Terraform, AWS/EKS, Kubernetes, and Jenkins.
DevOps Engineer
AWS DevOps Engineer designing and modernizing AWS infrastructure for Avahi, a cloud-first consulting company. Automating deployments with Kubernetes, Docker, and CI/CD pipelines.
Senior DevOps Engineer
Senior DevOps Engineer designing secure, scalable AWS platforms for Nalanda’s digital supply-chain and compliance solutions. Owning Terraform, GitOps, reliability, observability, and disaster recovery.
Senior DevOps Engineer
Senior DevOps Engineer owning Kubernetes-based deployments of Qodo’s AI code review platform in customer AWS, GCP, and Azure environments. Troubleshooting infrastructure and automating enterprise onboarding.
Senior DevOps Engineer
Senior DevOps Engineer für AWS- und Kubernetes-Infrastruktur bei LYNQTECH. Entwicklung von CI/CD, GitOps sowie Monitoring für die Digitalisierung der Energiewirtschaft.
Senior DevOps Engineer
Senior DevOps Engineer designing secure cloud-native products and developer platforms for Abstra, a Latin American tech talent services company. Improving automation, observability, reliability, and service delivery.
Senior DevOps Engineer
Senior DevOps Engineer building multi-region Azure application platforms for a pet health services company. Enabling safe deployments, reliable AKS workloads, and scalable cloud-native systems.
DevOps Engineer, Azure ARO
DevOps Engineer automating Azure infrastructure, OpenShift deployments, and CI/CD pipelines. Supporting PLATO, Canada’s Indigenous-owned software testing and technology services company.
Azure DevOps Administrator
Azure DevOps Administrator managing ADO environments, dashboards, workflows, and governance. Supporting PLATO’s software testing and technology services teams across Canada.
Senior/Staff DevOps Engineer
Senior/Staff DevOps Engineer scaling MEDvidi’s AI-powered mental healthcare platform on AWS and Kubernetes. Owning infrastructure reliability, security, observability, CI/CD, and developer experience.
Senior/Staff DevOps Engineer
Senior/Staff DevOps Engineer owning AWS, Kubernetes, security, and observability for MEDvidi’s AI mental healthcare platform. Driving reliable infrastructure and developer experience remotely from Portugal.
Senior/Staff DevOps Engineer
Senior/Staff DevOps Engineer owning AWS, Kubernetes, security, and reliability for MEDvidi’s AI-powered mental healthcare platform. Driving infrastructure strategy, observability, CI/CD, and developer experience remotely across EU.
Senior DevOps
Senior DevOps engineer building Azure, Terraform, and Databricks infrastructure. Supporting CI&T's enterprise AI transformation solutions through automation, governance, and reliable data platforms.
DevSecOps Developer – RMF
DevSecOps Engineer securing cloud infrastructure, applications, and Kubernetes environments for Federal Government agencies. Supporting DoD RMF/ATO documentation and authorization packages.