Job Description
7 days ago
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position
Financial AI Evaluator
Employment Type
Contract
Compensation
$105/hour
Location
Remote
Role Responsibilities
• Write and refine prompts to guide model behavior in financial contexts.
• Evaluate LLM-generated responses to finance-related queries for accuracy and clarity.
• Conduct fact-checking using trusted public sources and financial references.
• Annotate model responses by identifying strengths and areas for improvement.
• Assess tone and appropriateness of responses for real-world financial use cases.
• Apply consistent evaluation standards by following clear taxonomies and guidelines.
Qualifications
Must-Have:
• 5+ years of professional experience in Finance.
• Bachelor's, Master's, or PhD degree in Finance, Accounting, Economics, or related fields.
• Experience in Investment Banking, Corporate Finance, Accounting & Auditing, or Asset Management.
• Significant experience using large language models.
• Excellent writing skills and strong attention to detail.
Preferred:
• Experience with RLHF, model evaluation, or data annotation.
• Experience writing or editing high-quality financial content.
• Familiarity with evaluation rubrics or quality scoring systems.
Application Process (Takes 20–30 mins to complete)
• Upload resume
• AI interview based on your resume
• Submit form
Resources & Support
• For details about the interview process and platform information, please check:
• For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-Ljbffr
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position
Financial AI Evaluator
Employment Type
Contract
Compensation
$105/hour
Location
Remote
Role Responsibilities
• Write and refine prompts to guide model behavior in financial contexts.
• Evaluate LLM-generated responses to finance-related queries for accuracy and clarity.
• Conduct fact-checking using trusted public sources and financial references.
• Annotate model responses by identifying strengths and areas for improvement.
• Assess tone and appropriateness of responses for real-world financial use cases.
• Apply consistent evaluation standards by following clear taxonomies and guidelines.
Qualifications
Must-Have:
• 5+ years of professional experience in Finance.
• Bachelor's, Master's, or PhD degree in Finance, Accounting, Economics, or related fields.
• Experience in Investment Banking, Corporate Finance, Accounting & Auditing, or Asset Management.
• Significant experience using large language models.
• Excellent writing skills and strong attention to detail.
Preferred:
• Experience with RLHF, model evaluation, or data annotation.
• Experience writing or editing high-quality financial content.
• Familiarity with evaluation rubrics or quality scoring systems.
Application Process (Takes 20–30 mins to complete)
• Upload resume
• AI interview based on your resume
• Submit form
Resources & Support
• For details about the interview process and platform information, please check:
• For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-Ljbffr
More jobs from Mercor
Data Science
Central and Western, Hong Kong, China
7 days ago
Full Time
Onsite
Technology, Information and Media
More jobs like this
LLM Developer/Retail/30-50K HKD P/M/Extendable Contract
Argyll Scott Singapore
Central and Western, Hong Kong, China
🎉 Got an interview?
