Agent Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Agent Engineer assessing production LLM agent reliability, evaluation, observability, and adoption. Mercor pays for expert interviews on real-world agent systems.
Responsibilities:
- Build and operate LLM agents in production
- Assess agent reliability, evaluation, and adoption
- Run scheduled jobs, long-running agent work, and cloud sandboxes
- Analyze how agents are used and adopted inside companies
- Work with internal monoagents connected to company data, shared company memory, reusable skills and playbooks, and tool/MCP surfaces
- Improve visibility into agent actions and costs
- Complete a conversational AI screening interview
- Participate in a live 30-minute team conversation if selected
Requirements:
- Experience building and operating LLM agents in production
- Shipped an agent that real users depended on and handled production failures
- Ability to evaluate whether an agent improved or worsened after a change
- Experience running agents beyond a single request, including scheduled jobs, long-running work, or cloud sandboxes
- Experience observing adoption of internal company assistants
- Understanding of internal monoagents, company data, shared company memory, reusable skills and playbooks, tool and MCP surfaces, agent observability, and cost tracking
- Must complete a short conversational AI interview
- No coding or take-home assignment required
- Must be available for a live 30-minute conversation if selected
Benefits:
- $100 to $500 for the live 30-minute conversation, paid on completion of the call
- Up to $250 for each successful referral through the unique referral link
Similar Jobs
Senior Thermal Analysis Engineer
Senior Thermal Analysis Engineer analyzing thermal performance and designing cooling solutions for SolarEdge’s solar, storage, and EV energy products. Collaborating with electrical and mechanical designers on validated, cost-optimized designs.
Tech Services Engineer – Midstream and Downstream
Remote technical field engineer supporting Univar Solutions customers in midstream and downstream oil and gas. Troubleshooting operations, optimizing applications, and driving technical sales growth.
Journeyman Marine Propulsion Engineer
Marine propulsion engineer supporting U.S. Coast Guard vessel modernization and lifecycle engineering. Analyzing propulsion systems, ship machinery, and technical designs.
Principal Forward Deployed Engineer
Principal Forward Deployed Engineer embedding with customers to build secure agentic AI solutions. Integrating Docker with enterprise identity, Kubernetes, registries, and CI/CD systems.
Intermediate XR 3D Engineer
Intermediate XR 3D Engineer building Unity and C# AR features for Eterio’s FabStation industrial fabrication software. Developing HoloLens 2 and tablet experiences for steel fabricators.
Application Packaging Engineer
Application Packaging Engineer building and troubleshooting Windows application packages for the Department of Veterans Affairs. Supporting reliable enterprise deployment across thousands of federal endpoints.
Lead EHV Transmission Line Engineer 2 – Grid
Lead EHV transmission engineer designing 69kV–765kV power lines for Sargent & Lundy. Reviewing PLS-CADD models, guiding teams, and coordinating client-compliant engineering designs.
Engineer II, Field Service
Field Service Engineer II installing, troubleshooting, and repairing analytical instruments for Thermo Fisher Scientific. Supporting research, industrial, and healthcare customers across Iowa’s assigned territory.
Forward Deployed Engineer
Forward Deployed Engineer building AI workflows for RO Writer's auto-repair shop platform. Automating repair orders, estimates, and shop operations with customers and engineering.
Lead Release Train Engineer
Lead Release Train Engineer guiding complex SAFe Agile Release Trains at Humana, a healthcare and insurance services company. Driving program alignment, delivery predictability, and continuous improvement.
Technical Control Engineer
Technical Control Engineer supporting Symbotic’s AI-powered robotic warehouse automation systems remotely across the USA. Troubleshooting controls, networking, software, and electromechanical incidents while leading root-cause resolution.
Ingeniero/a Junior de Validación Ferroviaria
Ingeniero/a junior validando sistemas y productos ferroviarios para Expleo. Gestionando requisitos, trazabilidad y documentación técnica con IBM DOORS.
Global Quality Project Engineer
Global Quality Project Engineer driving digital transformation across Emerson’s automation technology and software operations. Developing quality tools, automating dashboards, and training global Flow Controls teams.
Service Desk Engineer
Service Desk Engineer resolving incidents and technical issues for Protera Technologies, a global SAP-focused IT outsourcing provider. Supporting mission-critical systems and 24x7 service desk operations.
Complaints Engineer II
Complaints Engineer investigating medical-device complaints, returned products, and adverse events for Terumo Medical Corporation. Supporting FDA, EU MDR, and global post-market surveillance compliance.
Senior Forward Deployed Engineer
Senior Forward Deployed Engineer building production Generative AI agents and full-stack applications for Sedgwick’s insurance operations. Deploying secure AWS services and partnering with claims and Managed Care teams.
CUDA Engineer
CUDA Engineer optimizing GPU kernels and LLM inference performance for MWDN, a global IT outstaffing company. Benchmarking modern GPUs, inference frameworks, and low-level systems.
CUDA Engineer
CUDA Engineer optimizing GPU kernels and LLM inference performance for MWDN, a global IT outstaffing company. Improving latency, throughput, and GPU utilization on modern systems.
CUDA Engineer
CUDA Engineer optimizing GPU kernels and LLM inference performance for MWDN, a global IT outstaffing company. Improving latency, throughput, and GPU utilization on modern hardware.
CUDA Engineer
CUDA Engineer optimizing GPU kernels and LLM inference performance for MWDN, a global IT outstaffing company. Improving latency, throughput, and GPU utilization on modern GPUs.