Builder Product II
Posted 2hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Product Manager defining AI-agent missions for ECI Software Solutions’ residential construction ERP products. Translating business logic into prompts, evaluations, and modernization priorities.
Responsibilities:
- Translate product ambition into executable missions for Residential Home Construction Products
- Work with the Industry PM and Value Stream PM to achieve strategy goals and key metrics
- Use LLMs to synthesize user research, generate acceptance criteria, and test assumptions
- Specify autonomous agent behavior and write mission briefs that constrain agents
- Translate ERP business logic and subject-matter expertise into system prompts and agentic constraints
- Define behavioral specifications for AI-agent interfaces, including tone, escalation logic, and failure modes
- Co-own evaluation frameworks, datasets, rubrics, and ground-truth definitions with the QA Builder
- Use AI to synthesize support tickets, usage telemetry, interview transcripts, UX research, and Signal information for prioritization
- Write structured Mission Specifications containing agent goals, tool constraints, success evaluations, and failure conditions
- Interview subject matter experts and encode business logic to prevent workflow hallucinations
- Rapidly prototype prompt chains to validate automation concepts
- Prioritize legacy modules using AI-assisted analysis of usage data, support volume, and codebase complexity
Requirements:
- Experience using LLMs to synthesize user research, generate acceptance criteria, and stress-test assumptions
- Ability to specify and pressure-test autonomous agent behavior
- Understanding of LangGraph state machines
- Ability to define measurable acceptance criteria, quantitative evaluations, and ground-truth definitions
- Ability to translate complex ERP business logic into structured system prompts, agentic constraints, and evaluation rubrics
- Ability to define behavioral specifications for generative UI experiences, including tone, escalation logic, and failure modes
- Experience co-owning evaluation frameworks and datasets
- Ability to conduct and synthesize user research, support tickets, usage telemetry, and interview transcripts
- Understanding of Python, SQL, LangChain, LangGraph, OpenAI APIs, Anthropic APIs, DSPy, GitHub, and Weights & Biases
- ERP business logic and customer workflow knowledge
- Experience using an LLM to specify, critique, or prioritize work
















