Head of Agent Architecture

Posted 3ds ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Head of Agent Architecture building scalable GenAI advertising systems for Pencil, an AI-powered advertising SaaS company. Leading agent strategy, reusable frameworks, client deployments, and an Agent Architecture team.

Responsibilities:

  • Define Pencil’s technical vision and roadmap for agent architecture, including multi-agent workflows, task decomposition, state management, and tool use
  • Hire, mentor, and manage a small team of Agent Architects
  • Set technical standards, provide real-time feedback, and run development conversations
  • Use and champion evaluation frameworks to measure agent performance
  • Own reusable agents and prompt libraries serving 1,000+ brands with unique voices
  • Decide what should be built as reusable platform functionality versus bespoke work
  • Partner with AI Engineering, Product, and Sales/Client leadership on prompting, RAG, and fine-tuning decisions
  • Serve as the final technical escalation point for complex client deployments
  • Lead discovery for high-stakes engagements and translate ambiguous client problems into buildable agent workflows
  • Present cost, latency, and reliability trade-offs to senior non-technical stakeholders
  • Represent Pencil’s agent technology with brand and agency stakeholders
  • Establish standards for decomposing client problems and explaining complex technical decisions in plain language
  • Drive system reliability, architectural efficiency, brand alignment, adoption at scale, client deployment success, stakeholder trust, and team growth

Requirements:

  • 8+ years of direct GenAI experience
  • 2+ years leading people or a function
  • Deep technical fluency with LLMs including GPT-4, Claude, and Gemini
  • Experience with multimodal models including Stable Diffusion, Midjourney, and video generation
  • Track record managing engineers or architects, or owning a function’s roadmap and outcomes
  • Systems thinking across latent space, context windows, and multi-agent inputs and outputs
  • Comfortable with Python, JSON structures, and API documentation
  • Experience with agent orchestration patterns such as task decomposition, tool use, and state management
  • Experience building or running benchmarking and A/B testing practices
  • Experience hiring and growing technical people, or owning a roadmap with stakeholder pressure
  • Ability to set strategic vision, gain senior leadership approval, and hold a team accountable
  • Demonstrated experience leading discovery with senior customers or stakeholders
  • Ability to turn vague briefs into scoped technical solutions
  • Background in solutions architecture leadership, forward-deployed engineering, or technical consulting is suitable
  • Ability to explain agent failure modes, evaluation results, and architectural trade-offs to non-technical stakeholders without jargon
  • Ability to translate creative direction into concrete system changes
  • Comfortable representing technology in client meetings

Benefits:

  • 25 days PTO plus public holidays, although we operate a Flexible Time Off scheme
  • Health insurance / private medical cover
  • Monthly stipend towards wellness, fitness, and learning and development
  • Remote - work from anywhere in your home country
  • Enhanced parental leave policies, whether you become a parent through birth, adoption or surrogacy
  • Access to our Pencil office in The Shard, London for UK employees
  • Flexible working hours