Senior Applied AI Engineer, GenAI, LLM Evaluation
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior AI & Data Engineer developing AI-powered data products for Acuity Analytics. Building scalable data pipelines and evaluating LLMs while collaborating with Data Scientists and Engineers.
Responsibilities:
- Build and maintain scalable data pipelines and workflows.
- Develop evaluation frameworks for GenAI and LLM applications.
- Create and maintain golden datasets for model testing.
- Evaluate and benchmark LLM performance.
- Build ML-assisted tools to improve delivery and automation.
- Deploy production-ready AI solutions.
- Work closely with delivery teams to solve technical challenges.
- Continuously improve data quality, automation, and operational efficiency.
Requirements:
- 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.
- Strong Python and SQL skills.
- Hands-on experience with Generative AI and Large Language Models (LLMs).
- Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.
- Experience building and deploying production-ready ML solutions.
- Strong understanding of data pipelines, validation, and quality frameworks.
- Experience integrating APIs and cloud-based AI services.
- Experience working in Agile, cross-functional teams.
- Consulting or customer-facing experience is a plus.
Benefits:
- People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.
Similar Jobs
AI Infrastructure Co-Founder, CSO
Co-Founder / CSO role at EWOR GmbH for ambitious entrepreneurs in AI Infrastructure startups. Involves personal development and direct mentoring for building high-revenue startups.
AI Engineer, Generative AI
AI Engineer developing and deploying generative AI applications with Amazon Bedrock. Focused on creating production-ready AI platforms for non-technical users using natural language.
Generative AI Engineer – LATAM Candidates Only
Generative AI Engineer developing advanced AI solutions leveraging LLMs at Talentus Global. Collaborating with various teams to integrate and improve AI applications in cloud environments.
Especialista I – Engenheiro de IA Generativa, Agentes
Implement independent reasoning flows and integrate via MCP for Grupo Boticário. Focus on developing tools and ensuring performance in AI operations.
Senior NLP/LLM Engineer
Senior NLP/LLM Engineer exploring and analyzing LLM capabilities while collaborating with cross-functional teams at Social Discovery Group. Enhancing AI models' effectiveness and optimizing their performance.
Senior Director, AI Infrastructure
Sr. Director of AI Infrastructure at ARMRA connecting business systems into a unified intelligent automation layer. Owning scalable architecture and AI playbook development across all functions.
Product Marketing Manager – Technical, AI Infrastructure
Product Marketing Manager defining market narratives and positioning for SubQ’s AI infrastructure products. Collaborating with cross-functional teams to drive product launches and technical messaging strategy.
Generative AI Engineer – Azure AI Search
Generative AI Engineer specializing in Azure AI Search, focusing on AI solutions for search and conversational experiences. Collaborating with technical and non-technical stakeholders to ensure AI outcomes are reliable and usable.
LLM Engineer, Prompting & AI Systems
LLM Engineer designing and integrating AI solutions for software systems. Collaborating with engineers to ensure reliability and utility for various users.
Generative AI Engineer
Generative AI Engineer building production-grade AI systems for a leading tech company. Focus on architecture, deployment, and operational improvement.
Manager – Generative AI Engineering
Seeking a Manager of GenAI Engineering to lead engineers and deliver generative AI systems in a remote setting. Overseeing technical work and ensuring quality in project execution.
VP Analyst, AI Infrastructure – Heads of I&O
VP Analyst at Gartner providing insights on AI infrastructure for senior IT and business leaders. Collaborating to integrate AI technologies and produce innovative, actionable insights.
Conversational AI Engineer
Conversational AI Engineer at Bush & Bush Law Group. Leading development and optimization of AI systems for client interactions and internal workflows.
Senior NLP/LLM Engineer
Senior NLP/LLM Engineer developing AI-driven platforms for social discovery. Focused on natural communication and personalized conversational AI experiences.
No more related jobs available.