Senior Finance, AI Evaluation Specialist
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior finance specialist designing financial tasks and evaluating AI-generated outputs for a generative AI initiative. Applying investment banking, valuation, and corporate finance expertise.
Responsibilities:
- Guide research and engineering teams on financial analysis, valuation, investment decisions, capital allocation, and corporate finance
- Identify gaps in model understanding across financial statements, transactions, markets, forecasting, and strategic decision-making
- Apply practical financial judgment to complex scenarios involving companies, investors, transactions, and commercial objectives
- Ensure finance tasks reflect realistic professional decisions and established industry practices
- Design challenging, domain-relevant tasks grounded in real financial practice
- Write accurate, well-reasoned solutions covering investment banking, asset management, corporate finance, and financial advisory scenarios
- Develop problems requiring quantitative analysis, commercial judgment, interpretation of financial information, and evaluation of trade-offs
- Ensure tasks are clear, internally consistent, and suitable for structured assessment
- Evaluate AI-generated finance responses against established rubrics and scoring criteria
- Assess correctness, financial judgment, reasoning quality, relevance, and practical applicability
- Compare alternative outputs and determine which response provides the stronger financial analysis
- Identify calculation errors, unsupported assumptions, weak financial logic, and incomplete conclusions
- Provide clear written feedback to support improvements in model behaviour
- Develop and refine evaluation guidelines for financial analysis and decision-making tasks
- Define scoring criteria covering technical accuracy, professional judgment, reasoning, and conclusion quality
- Participate in calibration activities with other finance specialists
- Collaborate across teams to maintain consistency and accuracy throughout the training data
- Complete onboarding, specialty calibration, task development, and ongoing quality review
Requirements:
- US-based; candidates must be based in the United States
- At least 8 years of dedicated professional experience in finance
- Senior-level expertise in investment banking, asset management, corporate finance, financial advisory, or a related area
- Experience working within a recognised financial institution, investment firm, professional-services organisation, or comparable company
- Prior hands-on experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria
- Demonstrable career progression into vice president, director, senior manager, or comparable leadership responsibilities
- Strong financial judgment and ability to assess complex analytical and commercial decisions
- Excellent written and verbal communication skills
- Reliable availability for at least 35 hours per week during weekdays
- Prior experience evaluating AI or LLM outputs against structured rubrics is required
- Applicants should clearly describe relevant AI evaluation experience in their application
- A degree in finance, economics, accounting, business administration, mathematics, or a related field is highly relevant
- Graduate-level education in finance, economics, business, or management may be helpful
- Equivalent senior professional experience in financial analysis, transactions, or investment management may also be considered
- Professional credentials such as CFA, CPA, CA, or comparable qualifications may be valuable
- Experience with valuation, financial modelling, mergers and acquisitions, capital markets, or portfolio analysis
- Background in transaction advisory, private equity, equity research, strategic finance, or investment management
- Experience creating structured scoring rubrics, evaluation guidelines, or quality frameworks
- Familiarity with model training, human-feedback workflows, annotation, or AI quality assurance
- Strong understanding of financial statements, forecasting, risk, capital structure, and investment analysis
- Experience reviewing financial models, investment recommendations, transaction materials, or strategic finance proposals
- Previous collaboration with product, analytics, research, engineering, or data-science teams
- Immediate availability is preferred
Benefits:
- Full-time W-2 contingent employment arrangement
- Fully remote work
- Competitive hourly compensation
- At least 35 hours per week during weekdays
- Immediate availability preferred
- Flexible project scope and duration according to programme requirements and performance
Similar Jobs
Vice President, Financial Planning and Analysis
Vice President leading FP&A for EverCommerce, a global service-commerce SaaS platform, supporting EverHealth’s planning, forecasting, reporting, and strategic decisions.
Applied Economics & Finance Benchmark Specialist
Economics and finance experts authoring and verifying rigorous assessment questions for Mercor’s AI benchmark projects. Creating gold-standard content to train and enhance frontier models.
FP&A Expert
FP&A Expert building budgets, reforecasts, profitability analyses, and reporting packs for Mercor’s AI training projects. Completing rubric-graded corporate finance exercises from mock data.
Excel Expert – Finance
Excel finance expert designing and evaluating financial-modeling tasks for Mercor’s frontier AI training initiatives. Applying advanced Excel expertise to improve next-generation language models.
Lead Consultant – Oracle Cloud Financials
Oracle Cloud Financials Lead Consultant guiding enterprise clients through finance implementations for Argano, a digital operations consultancy. Configuring modules, leading testing, and supporting go-live.
Senior Financial Analyst
Senior Financial Analyst leading FP&A modeling, forecasting, reporting, and automation. Supporting CallRevu’s AI-powered communication intelligence platform for automotive dealerships.
Investment Banking
Investment banking experts supporting Mercor’s AI-lab partners through financial modeling and analysis. Remote contract work training and enhancing frontier AI systems.
Intern – Financial Analytics, Technology
Financial Analytics Intern developing dashboards, analytics, automation, and AI-enabled solutions. Supporting Labcorp’s healthcare operations and financial decision-making through data-driven insights.
Accounts Specialist – Finance Coordinator
Accounts Specialist managing supplier payments, reconciliations, and discrepancies for Goway’s global tailor-made travel business. Supporting accurate financial operations across a distributed international team.
Volunteer Finance and Fundraising Coordinator – Live Peace
Ehrenamtliche Finanz- und Fundraising-Unterstützung für Go For Climate e.V.s globales Friedensevent Live Peace. Mitarbeit an Förderanträgen, Crowdfunding-Dokumenten und Businessplan.
Vice President, Financial Planning and Analysis
Vice President leading FP&A for EverHealth, EverCommerce’s healthcare software business. Owning forecasts, financial planning, executive reporting, and strategic decision support across the vertical.
FP&A Expert
FP&A Expert creating budgets, forecasts, management reporting, and profitability analyses for Mercor’s AI-training projects. Delivering rubric-graded corporate finance work products from mock data.
FP&A Expert
FP&A Expert building budgets, forecasts, and profitability analyses for Mercor’s AI-training projects. Producing rubric-graded planning deliverables as a fully remote independent contractor.
Finance Intern
Estagiário financeiro em home office na BHS, empresa de soluções modernas de TI. Apoio a transações, relatórios e rotinas administrativas financeiras.
Senior Financial Analyst, FP&A
Senior Financial Analyst building three-statement FP&A models for Vultr’s cloud infrastructure business. Supporting planning, forecasting, contract economics, and executive reporting.
Senior Analyst, Commercial Finance
Senior Analyst owning revenue forecasts, commercial expense planning, and financial modeling for GeneDx’s genomic testing business. Supporting executive decisions through analysis, reporting, and business cases.
Manager, Financial Reporting – Analysis
Financial Reporting & Analysis Manager leading close, controllership, and reporting for Aetna Medicare Supplement. Improving financial processes, controls, automation, and team performance at CVS Health.
Manager, FP&A – AI Enablement
Jabil finance manager scaling AI, automation, and digital productivity tools across FP&A. Leading governance, workflow integration, and adoption across global finance operations.
Strategic Financial Analyst
Strategic Financial Analyst supporting FP&A, pricing, commissions, and financial data systems at Actionstep, a legal practice management and accounting SaaS company. Building forecasts, models, dashboards, and commission calculations.
Financial Analyst
Financial Analyst managing budgets, forecasts, billing, and reporting for Clario’s global clinical research projects. Supporting Project Managers and finance teams to deliver accurate project financials.