DevOps Engineer – Platform, AI Evaluation
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
DevOps/Platform Engineer designing production-style cloud infrastructure and automation scenarios. Reviewing AI-generated technical solutions for correctness, reproducibility, and operational quality.
Responsibilities:
- Design realistic DevOps and infrastructure tasks based on production-style scenarios
- Create working reference solutions with clear setup, execution, and validation steps
- Develop scenarios covering CI/CD, containers, orchestration, Infrastructure as Code, monitoring, and incident response
- Review AI-generated technical outputs for correctness, completeness, and reproducibility
- Identify configuration, infrastructure, or implementation failures and provide precise corrections
- Validate that technical tasks can be reproduced consistently in the intended environment
- Apply a high quality bar to infrastructure design, automation, and operational workflows
- Document technical reasoning, expected outcomes, and troubleshooting steps clearly
- Provide structured feedback to improve future task and evaluation design
Requirements:
- At least 3 years of professional experience in DevOps, SRE, Platform Engineering, or Infrastructure Engineering
- Strong programming ability in Python, Go, Bash, or TypeScript, beyond basic scripting
- Hands-on experience with CI/CD using tools such as GitHub Actions, GitLab CI, or Jenkins
- Strong practical experience with Docker and Kubernetes
- Professional experience with at least one major cloud platform: AWS, GCP, or Azure
- Hands-on Infrastructure as Code experience with Terraform, Ansible, Pulumi, or CloudFormation
- Advanced working knowledge of Linux and Git
Similar Jobs
DevOps Engineer – m/f/d
DevOps Engineer managing cloud environments, CI/CD pipelines, automation, and security. Supporting diverse customer projects for German IT consulting company IT42morrow.
Cloud Specialist – DevOps
DevOps Cloud Specialist especializado en infraestructura para el principal partner de AWS en Latinoamérica. Automatización, seguridad, CI/CD y optimización de costos cloud.
Cloud Specialist, DevOps
DevOps Cloud Specialist gestionando infraestructura AWS, seguridad, automatización y escalabilidad. Impulsando CI/CD y cultura DevOps para empresas líderes mediante soluciones cloud.
Senior DevOps Engineer
Senior DevOps Engineer leading AWS, Kubernetes, Kafka, and CI/CD infrastructure for Veriforce’s contractor-risk management SaaS platform. Managing DevOps engineers and improving production reliability for global customers.
SRE Specialist I
Especialista SRE garantindo disponibilidade, segurança e desempenho de sistemas na Inmetrics. Automatizando infraestrutura cloud, observabilidade, Kubernetes e práticas DevOps para clientes em transformação digital.
DevOps Engineer – Platform
DevOps Engineer improving IP Fabric’s network-automation product platform. Modernizing deployments, CI/CD, containers, and developer experience across Europe.
Senior DevOps Engineer
Senior DevOps Engineer building DevOps for InfoTrust, a data-driven marketing performance company. Owning AWS and Google Cloud reliability, automation, databases, infrastructure security, and SOC 2 controls.
Site Reliability Engineer – Core Streaming
Site Reliability Engineer operating Yelp’s Kafka-based streaming infrastructure. Automating upgrades, scaling, incident recovery, and reliable data pipelines across Canada.
Senior Site Reliability Engineer – Network Observability
Senior SRE operating enterprise network observability platforms for Blueprint Technologies, a cloud, AI, and data solutions firm. Automating operations, troubleshooting telemetry systems, and improving reliability at scale.
Senior DevOps Engineer - Snowflake
Senior DevOps Engineer operating Snowflake and cloud AI platforms for phData, a data and AI consultancy. Leading managed-services reliability, incident response, automation, and client delivery.
SRE, Amazon Connect
AWS Infrastructure Engineer designing Amazon Connect environments and Terraform IaC for Miratech, a global IT services and consulting company. Automating deployments through CI/CD pipelines across development, staging, and production environments.
SRE, Amazon Connect
AWS Infrastructure Engineer managing Amazon Connect environments and Terraform IaC deployments for Miratech, a global IT services and consulting company. Building CI/CD pipelines and supporting secure, scalable cloud infrastructure across development, staging, and production.
SRE
AWS Infrastructure Engineer designing Amazon Connect environments and Terraform IaC for Miratech, a global IT services and consulting company. Building CI/CD pipelines and managing secure, scalable multi-environment AWS deployments remotely from India.
SRE, Amazon Connect
AWS Infrastructure Engineer designing Amazon Connect environments and Terraform deployments for Miratech, a global IT services and consulting company. Managing AWS infrastructure, CI/CD pipelines, and multi-environment cloud releases.
SRE – Amazon Connect
AWS Infrastructure Engineer managing Amazon Connect and Terraform deployments for Miratech, a global IT services and consulting company. Building CI/CD pipelines and reliable multi-environment cloud infrastructure.
AWS Site Reliability Engineer
AWS Site Reliability Engineer designing Amazon Connect environments for Miratech, a global IT services and consulting company. Automating AWS infrastructure with Terraform Enterprise and CI/CD pipelines across development, staging, and production.
Site Reliability Engineer, AWS
AWS Site Reliability Engineer designing Amazon Connect infrastructure for Miratech, a global IT services and consulting company. Automating multi-environment deployments with Terraform Enterprise and CI/CD pipelines.
Site Reliability Engineer, AWS
AWS Site Reliability Engineer designing Amazon Connect infrastructure and Terraform automation for Miratech, a global IT services and consulting company. Managing CI/CD deployments across AWS environments.
Site Reliability Engineer, AWS
AWS Site Reliability Engineer designing Amazon Connect infrastructure and Terraform deployments for Miratech, a global IT services and consulting company. Managing CI/CD pipelines, multi-environment deployments, monitoring, and cloud reliability.
Cloud / DevOps – SRE Engineer
Cloud/DevOps SRE Engineer designing AWS infrastructure and CI/CD systems for GoFasti, a LatAm talent-as-a-service company. Improving reliability, observability, security, and deployment automation for client applications.