Product Manager, Analytics & ML
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Product Manager/Analyst owning trusted analytics, A/B testing methodology, and ML recommendations for Maestra’s ecommerce marketing platform. Defining metrics and evaluating recommendation improvements.
Responsibilities:
- Own the data side of Maestra.io’s ecommerce marketing platform
- Design merchant-facing metrics and reports across attribution, loyalty economics, recommendation performance, popup funnels, and segment comparison
- Specify semantic-layer metrics, slices, aggregates, and partitions
- Prototype reports in SQL and hand specifications to engineering
- Resolve methodology issues involving cross-brand attribution, email opens, multi-currency revenue, and report discrepancies
- Own A/B testing methodology across widget tests, campaign tests, and flow control groups
- Audit experiments for comparable groups, participant counting, sample sizes, and statistical significance
- Define statistically correct defaults for merchants
- Own the recommendation stack, including quality evaluation, degradation monitoring, debugging, and improvement roadmap
- Decide how embeddings and LLM re-ranking should augment or replace classical collaborative filtering
- Prove ML improvements with honest evaluations against a baseline
- Use SQL, Python, Metabase, Notion, and Slack in a multi-tenant lakehouse environment
- Work horizontally with engineering, customer success, other product managers, merchants, and the founder-CEO
- Report directly to the founder-CEO/CPO
- Participate in asynchronous Q&A, a test task, and final hiring conversations
Requirements:
- Strong SQL, including window functions over huge partitioned tables and SQL performance optimization
- A/B testing mathematics and statistics fundamentals, including power, MDE, selection bias, survivorship bias, post-treatment variables, sample sizes, and significance
- Judgment on embeddings, vector similarity, LLM re-ranking, and evaluation against baselines
- Direct work with non-technical end users and ability to turn needs into shipped products
- Experience from B2B product, consulting, solutions engineering, or senior customer-facing roles
- Clear written thinking and ability to make methodology arguments in writing
- Russian as the working language inside the team
- English at B2+; fluency preferred
- Based in the EU
- Daily overlap with US Eastern time
- Strong plus: ecommerce or martech domain experience
- Strong plus: prior ownership of a metric or semantic layer
- Strong plus: hands-on exposure to recommender or ranking systems
Benefits:
- Skill growth close to guaranteed
- Career and compensation growth track the company’s growth
- Fully remote work arrangement
- Asynchronous-first work and hiring process
- Daily overlap with US Eastern time
- Exposure to real merchants and shipped work within weeks











