AI Prompt Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Prompt Systems Engineer designing and evaluating AI agents for Noodle, a higher-education strategy, services, and technology partner. Improving enrollment, learning, and student-support experiences.
Responsibilities:
- Own the design, testing, and continuous improvement of prompts and system instructions powering Noodle’s AI agents across enrollment, learning, and student support
- Write, iterate, and maintain system prompts and instruction sets
- Translate educational, operational, pedagogical, and business requirements into reliable agent behavior, including personas, tone, constraints, fallbacks, and multi-turn logic
- Design prompt architectures for multi-step, chained, and RAG-augmented agent workflows
- Collaborate with engineering to configure and deploy agents through Noodle’s AI orchestration platform
- Create three-way chat experiences connecting learners, campus or Noodle support staff, and AI assistants
- Build evaluation frameworks measuring accuracy, tone, hallucination rate, task completion, and alignment with learning objectives
- Use Langfuse to monitor production prompt performance, identify regressions, and prioritize improvements
- Design red-teaming and adversarial testing protocols
- Establish prompt versioning practices and maintain reusable prompt components
- Partner with Noodle teammates and university stakeholders to design, build, and test agents
- Tune companion agents for enrollment and student success teams and specific university contexts
- Contribute prompt engineering guidelines and best-practices documentation
- Track model capability changes across OpenAI, Anthropic, and other providers, surfacing opportunities and risks
- Perform other duties as assigned
Requirements:
- 2+ years of experience designing and iterating on prompts for LLM-powered applications in a production environment
- Deep familiarity with prompt patterns: few-shot examples, chain-of-thought, system vs. user roles, output formatting constraints, tool-use prompting, and RAG integration
- Strong written communication
- Experience building and running prompt evaluations: defining metrics, writing test cases, and interpreting results to make improvement decisions
- Comfort working across disciplines, including discussing context windows with engineers and Bloom’s Taxonomy with faculty members
- Experience with LLM observability tools (Langfuse, Weights & Biases, or similar)
- Familiarity with LTI (Learning Tools Interoperability) and AI integrations with LMS platforms such as Moodle, Canvas, or Instructure
- Experience with voice agents or multimodal prompting
- Comfort reading and writing basic JavaScript or Python for prompt automation and testing pipelines
- Knowledge of OpenAI, Anthropic, or other model provider APIs
- Ability to thrive in ambiguity and iterate quickly based on user feedback
- Ability to work effectively in a dynamic, rapidly changing, team-based environment
- Must be legally authorized to live and work in South Africa and maintain residency there throughout employment
Benefits:
- Work from the comfort of your home office!
- Great compensation package
- Tools you need on us! Laptop (Mac is our computer of choice) and EcoFlow inverter
- 12 weeks paid Parental Leave benefits
- 20 working days annual leave + 10 paid national holidays
- Medical/RA benefit
- Internet benefits
- Full access to our employee assistance program (EAP) through Company Wellness
- Annual education stipend for lifelong learning
Similar Jobs
AI Workflow Engineer
AI workflow engineer building Python and GenAI automation for BlueCross BlueShield of Tennessee. Supporting Treasury and Internal Audit workflow modernization, governance, training, and adoption.
Senior AI, Product Enablement Specialist
Senior AI and Product Enablement Specialist creating technical labs and training. Enabling customers on Sysdig’s cloud-native security solutions across containers, Kubernetes, Linux, and public cloud.
Senior AI & Product Enablement Specialist
Senior AI and Product Enablement Specialist building technical labs and training for Sysdig’s cloud security platform. Automating Kubernetes, Linux, and public-cloud learning environments.
AI Automation Lead
AI automation lead building workflows, CRM systems, and internal tools for Nucleus Network’s advisory, venture, and events businesses. Improving relationship data, efficiency, and scalable operations.
Engineer I, AI Agents
Engineer I building AI agent platforms for AARP, the nonprofit empowering older Americans. Developing LLM integrations, workflows, and enterprise solutions.
AI Leadership Industry Expert – University, Academic Experience
AI Leadership Facilitator delivering postgraduate AI Leadership education for peopleworth. Leading live sessions, mentoring learners, and supervising academic facilitators remotely.
AI Builder Grant
AI Builder Grant providing Claude access to university students in Austria, Germany, and Switzerland. Supporting personal AI projects and exposure to real-world artificial intelligence tooling.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing Mercor’s partner frontier AI models. Identifying jailbreaks, hallucinations, and policy failures across high-risk domains.
Trainer for CAD and Artificial Intelligence in Engineering
CAD- und KI-Trainer:in für digitale Produktentwicklung im Maschinenbau. Vermittlung generativer Design- und Engineering-Workflows an Fachkräfte.
CAD and Artificial Intelligence Trainer – Engineering
CAD- und KI-Trainer:in für die Weiterbildung von Maschinenbau-Fachkräften. Vermittlung generativer Design- und KI-gestützter Engineering-Workflows für die digitale Produktentwicklung.
Data Management & AI Analyst, Healthcare
Data-Analyst-Weiterbildung für Klinik-, Pflege- und Verwaltungsdaten bei DataSmart Point. Lernen von SQL, Power BI, Python und Predictive Analytics für digitale Gesundheitsprojekte.
AI Safety Expert – English, Assamese
AI safety red-teamer probing conversational models for Mercor’s frontier AI projects. Generating adversarial datasets, vulnerability reports, and attack cases to strengthen AI systems.
Marketing Expert – Marketing Analytics, AI Agent Environments
Marketing analytics expert designing realistic task environments for Mercor’s AI-agent training projects. Evaluating data diagnosis, attribution, reporting, and multi-tool decision-making.
AI Safety Expert – English, Danish
AI safety red teamer probing frontier AI models for Mercor. Testing jailbreaks, vulnerabilities, and harmful behaviors to generate safer human-data-driven AI systems.
Management Consultant – AI Strategy Evaluation
Management Consultant evaluating AI-generated strategy responses for Gramian Consultancy. Creating consulting prompts, reference answers, and feedback to improve model reasoning.
Senior Aerospace, Flight Dynamics Engineer – Simulation, AI Evaluation
Aerospace engineer creating and validating flight-dynamics simulations for Gramian Consultancy’s engineering talent solutions. Reviewing models, mission plans, and technical submissions for AI evaluation.
Senior Aerospace Engineer – Flight Dynamics, Simulation, AI Evaluation
Aerospace consultancy engineer creating and validating simulation-based flight-dynamics tasks. Reviewing aerodynamic designs, mission plans, and engineering solutions for AI evaluation.
Head of TEM Operations – AI Delivery, Senior Manager
Head of TEM Operations leading Cimpl’s enterprise managed-services engine. Modernizing telecom expense management through AI, automation, SLA excellence, and customer retention.
AI Policy Generalist
AI Policy Generalist evaluating AI model behavior for Handshake’s human-data business. Applying customer policies to ambiguous conversations and improving evaluation frameworks.
AI Solution Lead
AI enablement lead scaling responsible enterprise AI across LG Energy Solution Vertech. Evaluating solutions, building governance, training employees, and driving measurable adoption.