AI Platform Engineer
Posted 5hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI platform engineer building RAG, vector search, and Azure LLM integrations. Supporting secure, compliant AI applications for a supplemental benefits provider.
Responsibilities:
- Assist with building, testing, and supporting enterprise AI solutions using RAG, vector search, Azure AI services, and LLM integration
- Assist with implementing and testing RAG pipeline components, including embedding generation, vector storage, retrieval logic, ranking, context injection, and LLM response generation
- Support Azure OpenAI integrations, prompt engineering, grounding, validation, citation-based responses, and traceable outputs
- Configure, test, and maintain vector search solutions using Azure AI Search or equivalent technologies
- Support document chunking, segmentation, metadata enrichment, and hybrid, semantic, and keyword search testing
- Develop and maintain API integrations and orchestration components connecting data pipelines, vector search, LLM services, reporting platforms, and enterprise applications
- Implement error handling, logging, monitoring, and reusable service patterns
- Test and deploy AI applications through Azure DevOps CI/CD pipelines
- Use Azure Monitor and Log Analytics to check application health
- Perform initial troubleshooting of AI pipelines, APIs, retrieval systems, and LLM integrations; escalate complex issues
- Track token consumption, API utilization, and response performance
- Collaborate with IT, data, reporting, compliance, business, AI, backend, cloud, and platform engineering teams
- Test and document changes, maintain technical documentation, and follow production support, security, compliance, auditability, and governance procedures
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience through technical training, projects, or relevant work
- 2–4 years of relevant experience in software development, AI, platform development, or related technical work; internships, academic projects, and personal projects may count
- Foundational Python programming skills
- Basic understanding of backend development, REST APIs, and application integration
- Exposure to .NET, Node.js, or equivalent technologies
- Foundational understanding of LLM concepts and prompt development
- Exposure to Azure OpenAI or similar platforms
- Basic awareness of RAG, embeddings, and vector search concepts
- Basic understanding of cloud application concepts and Microsoft Azure
- Basic awareness of token consumption, usage-based LLM pricing, and monitoring performance and cost
- Foundational understanding of secure development and access control concepts
- Ability to follow training and documented procedures for handling PHI, PII, audit logs, and traceability in a regulated enterprise environment
Benefits:
- Skill-building, leadership development and philanthropic opportunities
- Medical, dental, supplemental health, life and vision coverage for you and your dependents with no wait period
- Life and disability insurance
- 401(k) with company match
- Tuition assistance
- Paid parental leave
- Backup family care
- Flexible time off
- Flexible dress code and work location policies
- Employee Resource Groups
- Social responsibility and community volunteering opportunities
- Competitive compensation package
- Potential eligibility for benefits, bonuses, and commission



















