Senior SRE, Databricks
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Data Infrastructure Engineer focusing on building and automating data platform on Google Cloud Platform. Ensuring security, scalability and efficiency in data infrastructure and governance.
Responsibilities:
- Create, maintain and evolve Terraform modules for provisioning the data infrastructure.
- Manage state management, workspaces and infrastructure versioning best practices.
- Ensure reproducible, auditable and traceable infrastructure via code.
- Provision and manage networks (VPCs, subnets, firewall rules) following security best practices.
- Configure IAM: roles, policies and service accounts with the principle of least privilege.
- Manage Google Cloud Storage (GCS) as the storage layer for the data platform.
- Ensure compliance with cloud security and governance policies.
- Provision and configure Databricks workspaces via Terraform/IaC.
- Manage clusters, jobs, notebooks and permissions on the platform.
- Integrate Databricks with GCP infrastructure (service accounts, VPC, GCS, IAM).
- Build and maintain CI/CD pipelines for infrastructure (GitHub Actions or similar).
- Apply GitOps practices: all infrastructure changes via Pull Request with review and automated validation.
- Ensure secure and auditable deployment across multiple environments (dev/staging/prod).
- Implement secrets and credential management following best practices (Secret Manager, Vault, etc.).
- Automate and standardize environments to ensure consistency and eliminate manual configuration.
- Support the data team with reliable, self-service infrastructure.
Requirements:
- Infrastructure as Code (IaC): Terraform with modules, state management and best practices.
- Google Cloud Platform (GCP): VPC, subnets, firewall rules, IAM (roles, policies, service accounts), GCS.
- Databricks: provisioning workspaces, managing clusters, jobs and notebooks.
- Version control with Git and GitOps practices.
- CI/CD pipelines (GitHub Actions, GitLab CI, Azure DevOps or similar).
- Cloud security: IAM, secrets, access policies and compliance.
- Automation and standardization of data environments.
- BigQuery: modeling, optimization and integration with the data platform. [**DIFFERENTIAL**]
- Apache Spark / PySpark for distributed processing. [**DIFFERENTIAL**]
- Delta Lake and Lakehouse architecture. [**DIFFERENTIAL**]
- Knowledge in Data Engineering and data pipelines (ETL/ELT). [**PLUS**]
- Kubernetes (GKE) for workload orchestration. [**PLUS**]
- FinOps: cloud cost optimization, rightsizing, reservations. [**PLUS**]
- Other IaC tools: Pulumi, Cloud Deployment Manager. [**PLUS**]
- Observability: monitoring, logging and alerting (Cloud Monitoring, Datadog, etc.). [**PLUS**]
Benefits:
- 🏥 Porto Seguro Health Insurance
- 🦷 Porto Seguro Dental Insurance
- 💰 Profit Sharing (PLR)
- 👶 Childcare Allowance
- 🍽️ Alelo Food and Meal Vouchers
- 💻 Home Office Allowance
- 📚 Partnerships with Educational Institutions
- 🚀 Support for Certifications, including Cloud
- 🎁 Livelo Points
- 🏋️♂️ TotalPass
- 🧘♂️ Mindself
- __ Temporary project until December, with the possibility of extension into 2027.__
Similar Jobs
Principal Cloud Developer – DevSecOps Experience
Principal Cloud Developer deploying a secured cloud-native platform for federal courts. Integrating security and compliance into all phases of cloud infrastructure and data products lifecycle management.
Senior DevOps Engineer, Kubernetes
DevOps Engineer supporting federal agencies in migrating cloud applications to Kubernetes clusters. Responsible for maintaining build infrastructure and troubleshooting critical issues in deployment pipelines.
Lead DevSecOps Engineer
Lead DevSecOps Engineer at ComPsych, creating secure, scalable infrastructures across multi-cloud environments. Mentoring engineers while embedding security in the software delivery lifecycle.
Senior DevOps Engineer
DevOps Engineer developing best-in-class health care reporting service using AWS solutions and CI/CD practices. Collaborating within a team to optimize cloud infrastructure and deployment processes.
Senior Site Reliability Engineer, C#, .NET
Senior Site Reliability Engineer at Climavision ensuring reliability of weather data services across various environments. Focused on improving operational maturity and handling complex production issues.
Lead DevSecOps Systems Engineer
Lead DevSecOps Systems Engineer at GDIT focusing on secure platform experiences for development teams and evolving cloud footprint with advanced technologies.
Interiors Design and Release Engineer, Junior
Design Engineer responsible for development of automotive interior components at ALTEN Mexico. Requires interaction with suppliers and proficiency in PLM/CAD tools.
DevOps Engineer II
DevOps Engineer II at Trustwell enhancing cloud-native platforms in food tech. Collaborating with agile teams for operational best practices and product support.
Senior Platform Engineer – DevOps, Infrastructure and Platform
Senior Platform Engineer at Ozmap responsible for AWS and Linux environments, troubleshooting, and building CI/CD pipelines for continuous delivery.
Senior Site Reliability Engineer
Senior Site Reliability Engineer maintaining highly available infrastructure for web data scraping solutions. Working with a team of over 500 professionals handling significant data traffic in multiple systems.
DevOps Engineer
DevOps Engineer responsible for designing, implementing, and maintaining cloud infrastructure in Azure at Pearster. Requires strong skills in Docker, Kubernetes and CI/CD pipelines with advanced English communication.
Technical Engineering Manager – Cloud, Dev Ops
Technical Engineering Manager leading high-performing cloud and DevOps teams. Guiding architecture and delivery of scalable, reliable, and secure cloud solutions for clients.
Lead – Agentic AI Forward Deployment Engineering
Agentic AI Forward Deployment Engineering Lead at Netomi transforming enterprise customer requirements into production-grade AI solutions. Collaborating with teams to ensure successful deployments and measurable business outcomes.
Junior Consultant, DevOps & Cloud Engineer
Junior Consultant DevOps & Cloud Engineer role at XAAS providing consulting for IT strategies and cloud architecture. Focus on building CI/CD pipelines and automating infrastructure.
Junior Site Reliability Engineer
Junior Site Reliability Engineer supporting system reliability and performance for accessible digital experiences at Fable. Collaborating with engineers to enhance infrastructure and developer experience.
Linux and Kubernetes SRE
Site Reliability Engineer ensuring systems reliability, scalability, and performance at Capgemini Engineering. Designing infrastructure automation and optimizing Kubernetes clusters in a dynamic L4 Support environment.
Junior Reliability Engineer
Junior Reliability Engineer providing reliability engineering support for operations and maintenance of buildings and equipment at JLL. Responsible for analysis, planning, and failure investigation to improve asset management and reliability.
Principal DevSecOps – Platform Engineer
DevSecOps Engineer developing and operating security automation platforms for Department of Defense and Federal customers. Focus on hands-on software development within a DevSecOps context.
Mainframe DevOps Migration Consultant
Mainframe DevOps Migration Consultant specializing in IBM Z application migration. Leading hands-on migration projects and client-facing support for complex z/OS environments.
Senior DevOps Engineer
Senior DevOps Engineer responsible for designing cloud architectures and collaborating with teams for infrastructure reliability. Leading best practices and production support in a multinational tech environment.