Applied AI Operations Lead
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Applied AI Operations Lead deploying and governing AI agents for Canvas Medical’s healthcare EMR platform. Advising customers on clinical workflow automation, adoption, and measurable ROI.
Responsibilities:
- Deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation
- Conduct workflow assessments and design agent implementations that deliver measurable ROI
- Configure and optimize agent performance using prompt engineering, context management, and tool selection
- Create and maintain customer-specific evaluation frameworks
- Maintain AI governance frameworks for safe, reliable production operations
- Design and implement monitoring systems for accuracy tracking, drift detection, and quality assurance
- Partner with clinical and compliance teams on regulatory and operational standards
- Develop and deliver training programs for care teams
- Work with OpenAI, Claude, Gemini, and the Canvas SDK to troubleshoot and optimize agent behavior
- Collaborate with Applied AI engineering to inform product improvements
- Build best practices, implementation templates, and governance playbooks
- Advise Canvas customers on AI-powered healthcare operations and strategy
- Lead executive conversations about AI strategy and competitive advantage
- Create customer success stories, performance metrics, and ROI analyses
- Partner with sales teams on strategic opportunities
- Collaborate with engineering, customer success, and technical marketing
Requirements:
- 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering)
- Demonstrated experience deploying and managing LLM-based applications in production environments
- Track record of driving successful enterprise technology implementations with measurable business outcomes
- Strong project management skills with ability to juggle multiple customer engagements simultaneously
- Hands-on experience with products offered from foundation model providers (OpenAI, Anthropic, Google) and AI tools for low-code automation, with understanding of their capabilities and limitations
- Understanding of AI safety, alignment, and governance principles
- Experience with evaluation frameworks, A/B testing, and performance monitoring for AI systems
- Learned experience with the edges and limitations of AI products, and understanding of the iterative process required to get high quality results
- Healthcare technology experience required, with ability to give workflow advice and construct automations that meet the needs of healthcare users
- Familiarity with HIPAA, clinical documentation standards, and healthcare compliance considerations
- Ability to quickly develop domain expertise and speak credibly with clinical stakeholders
- Comfort with ambiguity and ability to define structure in undefined spaces
- Exceptional written and verbal communication skills with ability to create compelling technical content
- Strong analytical and problem-solving abilities with data-driven approach to decision making
- Experience creating and delivering technical training to diverse audiences
- 5+ years of experience implementing workflow tools and automation solutions in enterprise settings, with 2+ years of hands-on experience with LLM-based systems
- Deep familiarity with foundation model capabilities and practical experience with context engineering and adversarial testing
- Ability to translate technical complexity into business value and present to technical teams and C-suite executives
- Consultative approach to customer engagement, diagnosing problems, designing solutions, and driving change management
- Experience in healthcare technology or strong willingness to rapidly develop domain expertise in clinical and operational workflows
- Technical depth with exceptional communication skills, including documentation, training, and stakeholder influence
Benefits:
- Competitive Salary & Equity Package
- Health Insurance (includes option with 100% family coverage)
- 401k
- Paid Maternity/Paternity Leave (12 weeks)
- Flexible/unlimited PTO
- Home Office Stipend
Similar Jobs
Commercial & Operations Manager – Life Sciences Partnerships
Commercial operations manager supporting Lighten’s AI-native clinical data platforms for life sciences organizations. Bridging executive, commercial, and clinical teams through proposals, pipeline management, and client requirements.
Operations Manager – Public Transport Compliance Manager
ÖPNV-Betriebsleiter für AllRides digitalen Linien- und On-Demand-Verkehr. Verantwortlich für Genehmigungen, Disposition, Compliance und den Aufbau des neuen Verkehrsbetriebs.
Channel Operations Lead
Amazon operations lead managing Seller Central, compliance, inventory, and profitability for mindbodygreen’s supplements and wellness business. Driving revenue and customer acquisition.
Senior Operations Manager – Delivery & Activation
Senior Operations Manager scaling KENTECH’s background-screening operations, client activation, and service delivery. Leading capacity, quality, financial discipline, and cross-functional execution.
Manager, Applications and Data Operations
Managing applications, databases, integrations, and data engineering for Vocate, a nonprofit higher education and workforce solutions provider. Leading an 8–10-person technical team and improving secure, reliable cloud operations.
Accounting Operations Specialist
Remote payment operations associate supporting Experience Columbus’s financial administration. Processing payments, reviewing invoices, reconciling transactions, and maintaining accurate records.
Operations Supervisor
Operations Supervisor leading healthcare processing teams for Centene. Improving production quality, workflows, customer satisfaction and operational efficiency.
Operations Engagement Manager
Operations & Engagement Manager coordinating organizational planning, communications, and employee experience for Nature United’s conservation mission. Managing cross-functional programs, budgets, workplace operations, and staff engagement.
Operations Lead
Operations Lead implementing M7 Health’s AI-powered healthcare workforce platform at hospitals. Leading go-lives, stakeholder training, adoption, and customer feedback for product improvements.
Phone Numbers Operations Specialist 2
Phone Operations Specialist supporting Twilio customers with number porting, short codes, Sender IDs, and carrier issues. Managing phone connectivity operations for a global communications platform.
Operations Customer Expert, German and English Speaker
Booking.com customer support expert assisting German- and English-speaking travelers with bookings, changes, and cancellations. Handling calls and written inquiries remotely from Georgia.
Operations Customer Expert, German – English
Customer Expert supporting Booking.com travelers with German-English assistance on bookings, changes, cancellations, and travel plans. Resolving issues remotely for TP Georgia.
Operations Customer Expert, German & English Speaking
Booking.com customer expert handling bookings, cancellations, and travel inquiries in German and English. Supporting travelers remotely through calls and written communication.
Identity & Access Operations Engineer L2 – Active Directory, LDAP, ADFS
L2 Identity and Access Operations Engineer supporting AD, LDAP, and ADFS infrastructure at Gruve, an AI-focused software services startup. Troubleshooting authentication, access, federation, and security operations.
Endpoint Operations Analyst L1 – Intune, SCCM
Endpoint Operations Analyst supporting Windows endpoint operations for Gruve, an enterprise AI transformation software services startup. Managing Intune/SCCM monitoring, troubleshooting, compliance checks, and 24x7 incident escalation.
R2R Operations Excellence Lead
R2R Operations Excellence Lead driving Lean Six Sigma, automation, and continuous improvement. Supporting Sales Consulting's HR consulting services and global GBS operations.
Territory Operations Manager – Subcontinent
Territory Operations Manager leading customer support, distributors, and service profitability for Accuray’s cancer radiotherapy systems across India and the subcontinent.
Operations Supervisor
Operations Supervisor leading hiring, workflow, quality, and performance management for Centene healthcare production teams. Remote role open in New York, Pennsylvania, Florida, and New Jersey.
Director, Site Operations
Director leading warehouse, transportation, budgets, KPIs, and team development for Quirch Foods in New Jersey. Ensuring compliant, accurate operations and customer satisfaction.
Commercial Operations Analyst
Analista de operações comerciais na Datacom, desenvolvedora de soluções de tecnologia e telecomunicações. Gerenciando propostas, licitações, contratos, faturamento, entregas e pós-venda.