AI Engineer – Specialist
Posted 8ds ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Engineer designing and developing solutions based on LLMs at Grupo SysMap. Responsible for evaluating quality and implementing security measures in AI models.
Responsibilities:
- Design, develop, and optimize advanced prompts, reasoning chains (prompt chains), and multi-step flows for LLM-based solutions, ensuring consistency, accuracy, and scalability;
- Define and implement quality evaluation strategies, including automated metrics, A/B testing, internal benchmarks, and continuous analysis of production results;
- Establish safety guardrails, response standards, and control mechanisms to mitigate hallucinations, biases, and undesirable model behaviors;
- Develop and maintain prompting standards (zero-shot, few-shot, system prompts, tool use), documenting best practices and promoting reuse across teams;
- Contribute to the definition and evolution of LLM-based architectures, including RAG (when applicable), model selection, technical trade-offs, and alignment with business requirements;
- Ensure compliance with security, privacy, and data protection policies, including prevention of PII leakage, response auditing, and responsible use of AI models;
- Collaborate with product, engineering, and UX teams to integrate AI solutions into real products, ensuring good user experience, observability (logging, metrics), and reliability;
- Analyze failures, user feedback, and production data to continuously iterate on prompts, evaluations, and solution architectures;
- Stay up to date with trends and developments in the generative AI ecosystem, proposing technical improvements and innovations applicable to the business.
Requirements:
- Hands-on experience with LLMs (specify models, use cases, and outcomes);
- Prompting techniques: structuring prompts, few-shot/zero-shot approaches, and tool use;
- Evaluation: quality metrics, A/B testing, and validation datasets;
- Security and privacy: prevention of data leakage, PII protection, and related policies;
- RAG: embeddings, chunking, retrievers, vector stores, and relevance tuning;
- Product integration: APIs, chat UX, and logging/observability.
Benefits:
- N/A













