Senior Software Engineer – AI Interaction Evaluator, Codex / Claude Code
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior engineer evaluating OpenAI Codex and Claude Code interactions for G2i. Assessing AI reasoning, explanations, and engineering judgment across coding workflows.
Responsibilities:
- Evaluate AI-generated coding interactions end-to-end
- Judge whether outputs are useful, correct at a high level, and aligned with strong engineering thinking
- Assess the quality of explanations and reasoning, not just code
- Distinguish between different levels of response quality
- Provide clear, opinionated feedback on what worked, what did not, and what felt misleading
- Help define what great interaction looks like for tools such as Cursor
Requirements:
- Highly experienced software engineer at Staff / Principal level or equivalent experience
- Strong background in TypeScript / JavaScript or Python
- Hands-on experience using OpenAI Codex, Claude Code, and Cursor
- Deep familiarity with modern AI-assisted development workflows
- Ability to evaluate code without fully executing or deeply reviewing every line
- Comfortable giving direct, opinionated feedback
- High bar for strong engineering quality
- Nice to have: experience with Cursor or similar AI-first IDEs
- Nice to have: prior exposure to prompt design or evaluation workflows
- Nice to have: experience mentoring senior engineers or defining engineering standards
- Must complete a take-home evaluation exercise and one behavioral interview
Benefits:
- Possible contract extension
- Flexible part-time engagement of approximately 10–20 hours per week
Similar Jobs
Senior Rust Engineer – AI Code Evaluation
Senior AI evaluator reviewing coding-agent reasoning and outputs for modern development tools such as OpenAI Codex, Claude Code, and Cursor. Providing rigorous feedback on engineering judgment, explanations, and interaction quality.
Forward Deployed AI Engineer
Forward Deployed AI Engineer deploying agentic workflows and integrations in ServiceNow environments. Translating enterprise needs into customer solutions while advancing NewRocket’s AI platforms.
AI Engineer, Freelancer/Consultant
AI Engineer building LLM, RAG, and agentic AI systems for a Weekday client. Designing document intelligence pipelines and deploying scalable AI services across cloud platforms.
Senior Architect, AI in the Statutory Health Insurance (GKV) Sector
Senior Architekt entwickelt sichere KI- und Softwarelösungen für virtual7, einen IT-Dienstleister für die Digitalisierung des öffentlichen Sektors. Verantwortung für Architektur, technische Umsetzung und Datenschutz im deutschen Gesundheitswesen.
Senior Software Engineer, AI Products – Agents
Senior Software Engineer building NextJS, FastAPI, and AI-powered products for Paramount Streaming. Owning internal data tools that guide streaming performance, audience, and content decisions.
Copilot Developer, AI Engineer – 1-2 years experience
Microsoft Power Platform and Copilot developer building compliant AI automation solutions for consulting clients. Designing agents, workflows, integrations, and locally run Claude solutions in a regulated environment.
Founding Engineer, AI Platform
Founding engineer building Ember AI’s enterprise intelligence workspace from meetings, email, documents, Slack, and operational systems. Developing agents, connectors, workflows, and scalable platform primitives.
Software Engineer – AI & Platform
Software Engineer building AI-powered applications, agents, and automated workflows for staffing solutions provider Buddle. Maintaining AWS/Terraform platforms, observability, integrations, and production reliability.
Python Developer – AI
Desenvolvedor Python criando APIs, pipelines e produtos de IA para provedora de dados comerciais da América Latina e Caribe. Explorando LLMs, agentes, RAG e Document AI.
Full Stack AI Engineer
Full Stack AI Engineer developing agentic clinical AI systems for Reveleer’s value-based care technology platform. Building backend, frontend, cloud infrastructure, and scalable data pipelines.
Senior Software Engineer, AI-First
Senior Software Engineer applying AI-first development to build scalable cloud-native enterprise software for CI&T. Collaborating across engineering teams and mentoring developers while improving delivery, quality, and productivity.
AI Engineer
AI Engineer building production multi-agent AI systems for an organization automating knowledge-based workflows. Owning RAG, integrations, cloud deployment, monitoring, security, and governance end to end.
Senior Applied AI Engineer
Senior Applied AI Engineer building production-ready agentic AI solutions for phData, a data and AI consultancy. Delivering RAG pipelines, multi-agent workflows, and enterprise integrations for measurable client outcomes.
Senior Golang Engineer – AI Platform
Senior Golang Engineer building scalable AI platform services, APIs, and LLM workflows for blau direkt, a leading insurance technology provider. Owning technical initiatives from architecture through production operation.
AI Engineer
Remote AI Engineer building LLM, RAG, vector-search, and agent systems for Hire Hangar’s global clients. Integrating models into production applications and collaborating across US time zones.
Cloud – AI Developer
Cloud/AI Developer building Java and GCP image-processing applications for GDIT’s U.S. government missions. Integrating AI, secure APIs, CI/CD, and cloud-native services.
Senior Software Engineer – AI-Augmented Development
Senior Software Engineer developing AI-augmented Hyperautomation and Workflow-Management products for DATAGROUP. Designing, building, securing, testing, and deploying scalable fullstack applications.
Staff Enterprise AI Engineer – Agentic Workflows, Productivity
Staff AI Engineer leading Calix’s enterprise agent platform for broadband providers. Building agentic workflows, RAG pipelines, integrations, and governance across product development.
Principal Data & AI Architect
Principal Data & AI Architect designing secure agent runtimes, APIs, and scalable pipelines for Publicis Groupe’s marketing technology products. Mentoring engineers and setting cross-platform architecture.
Lead AI Software Engineer, AI Platform – Architecture
Lead AI platform architecture and production systems for G-P, whose SaaS platform helps organizations build global teams. Improving engineering practices, cloud infrastructure, and AI delivery across teams.