Middle Prompt Engineer
Posted 12ds ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Middle Prompt Engineer designing and optimizing prompts for AI moderation systems at Cupid Media. Collaborating with global teams on user-generated content and evaluation metrics.
Responsibilities:
- Design and optimize prompts for LLMs used in moderation of user-generated content (UGC)
- Test and evaluate prompts across diverse scenarios to improve accuracy and reliability
- Analyze model outputs to identify hallucinations, errors, and moderation gaps
- Develop evaluation metrics and benchmarking pipelines (precision, false positives, false negatives)
- Create and maintain labeled datasets for evaluating moderation quality
- Run experiments with different LLMs to improve moderation performance
- Collaborate with engineering and moderation teams to improve AI moderation systems
Requirements:
- 2+ years of experience working with LLM systems or applied AI
- Experience with prompt engineering in production environments
- Strong understanding of prompting techniques (zero-shot, few-shot, chain-of-thought, role prompting)
- Experience evaluating LLM outputs and analyzing errors (false positives / false negatives)
- Experience working with labeled datasets and evaluation workflows
- Basic programming skills (Python, JavaScript, or TypeScript)
- Familiarity with Git
- Analytical mindset and strong problem-solving skills
- Ability to work independently and take ownership of results
Benefits:
- REMOTE OPPORTUNITY to work full time;
- Vacation 28 calendar days per year;
- 7 wellness days per year (time off) that can be used to deal with household issues, to lie down and recover without taking sick leave;
- Bonuses up to $5000 for recommending successful applicants for positions in the company;
- 50% payment for professional training, international conferences and meetings ;
- Corporate discount for English lessons;
- Health benefits. According to the paychecks, if you are not eligible for corporate medical insurance, the company will compensate you with up to $ 1,000 gross per year per employee. This can be spent on self-purchase of health insurance or on doctor’s fees for yourself and close relatives (spouse, children);
- Workplace organization. The company provides all employees with an equipped workplace and all the necessary equipment (table, armchair, wifi, etc.) in our offices or co-working locations. In the other locations, the company provides reimbursement of workplace costs up to $ 1000 gross once every 3 years, according to the paychecks. This money can be spent on the rent of the co-working room, on equipping the working place at home (desk, chair, Internet, etc.) during those 3 years;
- Internal gamified gratitude system: receive bonuses from colleagues and exchange them for our merchandise, team building activities, massage certificates, etc.



















