Builder Product II

Posted 2hrs ago

Employment Information

Industry
Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Product Manager defining AI-agent missions for ECI Software Solutions’ residential construction ERP products. Translating business logic into prompts, evaluations, and modernization priorities.

Responsibilities:

  • Translate product ambition into executable missions for Residential Home Construction Products
  • Work with the Industry PM and Value Stream PM to achieve strategy goals and key metrics
  • Use LLMs to synthesize user research, generate acceptance criteria, and test assumptions
  • Specify autonomous agent behavior and write mission briefs that constrain agents
  • Translate ERP business logic and subject-matter expertise into system prompts and agentic constraints
  • Define behavioral specifications for AI-agent interfaces, including tone, escalation logic, and failure modes
  • Co-own evaluation frameworks, datasets, rubrics, and ground-truth definitions with the QA Builder
  • Use AI to synthesize support tickets, usage telemetry, interview transcripts, UX research, and Signal information for prioritization
  • Write structured Mission Specifications containing agent goals, tool constraints, success evaluations, and failure conditions
  • Interview subject matter experts and encode business logic to prevent workflow hallucinations
  • Rapidly prototype prompt chains to validate automation concepts
  • Prioritize legacy modules using AI-assisted analysis of usage data, support volume, and codebase complexity

Requirements:

  • Experience using LLMs to synthesize user research, generate acceptance criteria, and stress-test assumptions
  • Ability to specify and pressure-test autonomous agent behavior
  • Understanding of LangGraph state machines
  • Ability to define measurable acceptance criteria, quantitative evaluations, and ground-truth definitions
  • Ability to translate complex ERP business logic into structured system prompts, agentic constraints, and evaluation rubrics
  • Ability to define behavioral specifications for generative UI experiences, including tone, escalation logic, and failure modes
  • Experience co-owning evaluation frameworks and datasets
  • Ability to conduct and synthesize user research, support tickets, usage telemetry, and interview transcripts
  • Understanding of Python, SQL, LangChain, LangGraph, OpenAI APIs, Anthropic APIs, DSPy, GitHub, and Weights & Biases
  • ERP business logic and customer workflow knowledge
  • Experience using an LLM to specify, critique, or prioritize work