Evaluations Operations Analyst – Contract
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Evaluations Operations Analyst at Cartesia supporting evaluation operations for AI model development. Managing annotator tasks and coordinating workforce efforts for quality assurance.
Responsibilities:
- Serve evaluation tasks to our annotator workforce and manage assignment distribution across projects and locales.
- Track and verify completion of assignments, flagging delays or issues before they become blockers.
- Act as a first line of support for evaluators, fielding operational questions about project setup, platform access, and task instructions.
- Help maintain project trackers, assignment records, and operational documentation.
- Support calibration workflows as needed to ensure evaluation data meets our quality bar.
Requirements:
- Experience managing or coordinating annotator workforces, including task assignment, scheduling, and follow-up.
- Hands-on experience with data annotation platforms.
- Strong written communication skills, particularly in coordinating with globally distributed contractor workforces in different time zones and language groups.
- Ability to work independently and manage your own time effectively to meet tight project deadlines.
- Comfort working in spreadsheets, task management tools (e.g., Asana), and messaging platforms (e.g., Slack).
Benefits:
- Competitive base salary alongside attractive equity package.
- Fully covered medical insurance along with dental and vision for you and your family.
- 9 weeks paternity & 12 weeks maternity leave
- 401(k)
- A monthly stipend to help you get to and from the office.
- Take as much time as you need to recharge your batteries.
- Lunch, dinner and plenty of snacks, provided daily.
- Your own personal Yoshi
Similar Jobs
Sales Strategy & Operations Manager
Sales Strategy & Operations Manager at Tremendous, a global platform for businesses to send payouts. Oversee sales operations, provide strategic analysis, and enhance automation in a fully remote setting.
U.S. Operations Intern
U.S Operations Intern supporting borrower application processes and managing operational improvements at Kiva, a nonprofit expanding financial access.
Strategic Operations Manager
Strategic Operations Manager enhancing service delivery for Daktronics. Leading initiatives that improve customer experience and operational efficiency in a dynamic environment.
Psychiatry Operations Associate
Operations Associate supporting psychiatry program by improving processes and client access. Collaborating with various teams to enhance communication and operational efficiency in mental healthcare.
Operations Manager, Digital Hub
Operations Manager leading digital hub for healthcare AI, driving operations, team development, and project stabilization. Engaging in direct management and AI integration for better patient support.
Channel Programs & Operations Manager
Manage and improve existing partner programs ensuring alignment with business goals at Akamai. Collaborate with teams to support technology partners worldwide through operational excellence and program success.
Integrated Operations Assistant — Candidates with Disabilities
Assistente de Operações Integradas supporting e-commerce and financial services at Méliuz. Responsibilities include performance monitoring and process improvement.
Customer Operations
National Customer Experience Manager at JLL managing customer engagement initiatives and ensuring premium brand standards. Collaborating with various teams to enhance customer experience across portfolios.
Sales Operations Strategy – Solution Design
Director of Revenue Operations implementing technology and performance improvement initiatives at Lift Enablement. Collaborating with clients and teams, ensuring successful adoption and delighting clients in the process.
Solar Operations & Maintenance Technician, Level 1
Solar Operations & Maintenance Technician Level 1 performing inspections, maintenance, and troubleshooting on solar energy systems. Join a dynamic company focused on renewable energy solutions.
Solar Operations & Maintenance Technician – Level 2
Solar Operations & Maintenance Technician Level 2 ensuring safe, reliable, and effective solar system operations. Conducting inspections, maintenance, and system troubleshooting independently.
Senior Manager, Strategic Rideshare Operations – Growth
Senior Manager overseeing marketplace growth and driver acquisition for SafeRide Health. Building operational frameworks and ensuring compliance in the development of a new independent driver network.
Dealership Operations Specialist
Dealership Operations Specialist enhancing customer experiences and profitability for dealerships. Working collaboratively to drive business growth while leveraging data and technology.
Operations Manager – Last Mile
Operations Manager for RXO overseeing daily operations of contract carriers. Responsible for route planning, staff development, and operational compliance.
Coordination administrative et gestion des opérations
Operational coordinator assisting the founder at Huppée creative agency specialized in marketing for SMEs. Ensuring documentation, tracking, and measurement of ongoing tasks and projects.
Planning & Portfolio Manager – US Operations
Planning & Portfolio Manager driving cross-functional initiatives for US Operations team in a global organization. Ensuring alignment of business demand, operational capacity, and strategic priorities.
Senior Analyst, Reporting – ROPS
Support distribution, maintenance, and production of reports for business improvements at DaVita. Collaborate across teams and manage reporting-related tasks.
Senior Analyst, Business – ROPS
Regional Registration Specialist at DaVita validating patient insurance information and ensuring accurate claims submission. Collaborating with facilities and managing patient registrations across dialysis centers in a geographic region.
Senior Manager – Sponsorship Operations
Senior Manager of Sponsorship Operations for Young Life connecting donors and staff in mission partnership. Leading development efforts to secure new sponsors and oversee camp campaigns.
Solution Operations Support – Managed Technology and Digital Solutions
Solution Operations Support coordinating projects, maintaining operational reports for MTS/DS team. Partnering with leadership to facilitate initiatives and ensure timely execution.