Senior Marketing Strategy, AI Evaluation Specialist
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior marketing strategist designing evaluation tasks and rubrics for generative AI models. Assessing AI-generated marketing content using brand, growth, and performance expertise.
Responsibilities:
- Guide research and engineering teams on brand strategy, growth marketing, performance marketing, and campaign-planning concepts
- Identify gaps in model understanding across customer segmentation, positioning, channel strategy, creative development, and measurement
- Apply practical marketing judgment to complex scenarios involving brands, audiences, markets, and commercial objectives
- Ensure marketing tasks reflect realistic business decisions and professional standards
- Design challenging, domain-relevant tasks grounded in real marketing practice
- Write accurate, well-reasoned solutions covering brand, growth, campaign, and performance-marketing scenarios
- Develop problems requiring strategic judgment, prioritisation, interpretation of data, and evaluation of trade-offs
- Ensure tasks are clear, internally consistent, and suitable for structured assessment
- Evaluate AI-generated marketing responses against established rubrics and scoring criteria
- Assess correctness, strategic judgment, reasoning quality, relevance, and practical applicability
- Compare alternative outputs and identify which response provides the stronger marketing recommendation
- Document factual errors, unsupported assumptions, weak strategic logic, and incomplete analysis
- Provide clear written feedback that supports improvements in model behaviour
- Develop and refine evaluation guidelines for brand, growth, campaign, and performance-marketing tasks
- Define scoring criteria for strategic quality, commercial judgment, reasoning, and execution feasibility
- Participate in calibration activities with other marketing specialists
- Collaborate across teams to maintain consistency and accuracy throughout the training data
Requirements:
- US-based senior marketing professional
- At least 8 years of dedicated professional experience in marketing
- Senior-level expertise in brand strategy, growth marketing, performance marketing, campaign strategy, or related areas
- Experience working within a recognised consumer brand, agency, technology company, or comparable organisation
- Prior experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria is required
- Demonstrable career progression into senior manager, director, vice president, or comparable leadership responsibilities
- Strong commercial judgment
- Ability to evaluate complex marketing decisions
- Excellent written and verbal communication skills
- Reliable availability for at least 35 hours per week during weekdays
- A degree in marketing, business administration, communications, economics, consumer psychology, or a related field is highly relevant
- Graduate-level education in marketing, strategy, business, or management may be helpful
- Equivalent senior professional experience in brand, growth, or performance marketing may also be considered
- Professional training in analytics, market research, digital marketing, or AI evaluation may be valuable
- Applicants should clearly describe relevant AI evaluation experience in their application
- Immediate availability is preferred
Benefits:
- Full-time remote engagement
- Competitive hourly compensation
- W-2 contingent employment arrangement
- Remote consulting opportunity
- Immediate availability preferred
- Work may include onboarding, specialty calibration, task development, and ongoing quality review
Similar Jobs
AI Evaluation Guidelines & Rubric Specialist
AI evaluation specialist developing precise rater guidelines and scoring rubrics for generative AI programmes. Translating complex requirements across finance, legal, retail, insurance, and sports domains.
U.S. Licensed Dermatologist – AI Dermatology Research
U.S.-licensed dermatologist reviewing skin images and AI-generated assessments for 24-MAG LLC’s dermatology research. Establishing clinical guidelines and improving medically grounded AI systems.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI systems for Mercor. Designing adversarial prompts and evaluating high-risk model behavior with AI researchers.
AI Safety Red Teamer
AI Safety Red Teamer adversarially testing frontier AI models for Mercor, which partners with AI labs to train and enhance them. Documenting vulnerabilities across high-risk domains.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Designing adversarial prompts and documenting vulnerabilities to improve AI alignment and safety.
AI Data & Insights Officer
AI Data & Insights Officer turning event and luxury-travel business data into reliable intelligence. Building RAG, dashboards and agent-performance insight for Worldwide Events Group.
AI Data & Insights Officer
AI Data & Insights Officer transforming Worldwide Events Group’s MICE and luxury travel data into reliable intelligence. Building RAG knowledge systems, dashboards and measurable agent performance insights.
Data & AI Analyst
Data & AI Analyst transforming insurance marketing data into actionable insights, dashboards, and AI-powered automation. Building scalable solutions with SQL, BigQuery, Tableau, Python, and emerging AI tools.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Designing adversarial prompts and documenting vulnerabilities across high-risk domains.
AI Safety Expert, English, Finnish
AI red team expert testing Mercor’s frontier AI models through jailbreaks, prompt injections, and adversarial data generation. Producing reproducible vulnerability reports that improve AI safety.
AI Director
AI Director leading production AI architecture, governance, and client strategy at Futurice, a data-and-AI consultancy. Growing UK capability through consulting, business development, mentoring, and hiring.
Independent Zen Ambassador – AI Solutions
Ambassadeur freelance prospectant des dirigeants et les connectant à des solutions IA et experts B2B. David assure la vente, avec rémunération au succès et bonus.
Junior AI, Product Enablement Specialist
Junior enablement specialist building AI-assisted cloud-security training labs and technical content for Sysdig. Supporting DevOps training delivery, workshops, automation, and courseware development.
Head of AI – Processes
Head of AI & Processes leading AI consulting, process transformation, and automation growth. Developing LM IT Services’ practice, team, portfolio, and international customer projects.
Delivery Director – AI Foundry, Anthropic Business
Delivery Director leading NewRocket’s enterprise AI and Anthropic services portfolio. Driving delivery excellence, client growth, responsible AI adoption, and operational performance.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI models for Mercor. Designing adversarial prompts and evaluating high-risk AI behaviors.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying jailbreaks, hallucinations, and policy failures across high-risk domains.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor’s AI training projects. Identifying vulnerabilities and improving model alignment, robustness, and safety.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying jailbreaks, vulnerabilities, and safety failures through adversarial evaluation.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train models. Finding vulnerabilities and improving model safety through adversarial evaluation.