Blueprint→
Chinese-Speaking AI Evaluation Specialist at Blueprint in Remote
Entry LevelRemoteFull-timeRemote$62k–$73k/yr
Skills
structured evaluationdata annotationai evaluationsearch relevanceanalytical thinkingchinese language fluencyenglish reading comprehension
Job Description
Summary: Blueprint is a technology solutions firm headquartered in Bellevue, Washington, focused on solving complex problems with unique perspectives and expertise. They are seeking a Chinese-Speaking AI Evaluation Specialist to assess and improve the quality of AI-generated responses in Chinese, ensuring accuracy, relevance, and cultural appropriateness.
Responsibilities:
- Evaluate and compare AI-generated responses in Chinese
- Perform side-by-side analysis of outputs from different AI systems
- Assess responses for accuracy, relevance, clarity, and instruction-following
- Identify nuances in meaning, tone, and cultural context
- Apply structured annotation guidelines consistently
- Work with datasets of real user queries
Required Qualifications:
- Native or professional fluency in Chinese
- Strong English reading comprehension
- Analytical thinking and attention to detail
- Experience with structured evaluation or guidelines
Preferred Qualifications:
- Background in linguistics, translation, or localization
- Experience with data annotation, AI evaluation, or search relevance
Required Skills: Structured evaluation, Data annotation, AI evaluation, Search relevance, Analytical thinking, Chinese language fluency, English reading comprehension
Benefits: Medical, dental, and vision coverage, Flexible Spending Account, 401k program, Competitive PTO offerings, Parental Leave, Opportunities for professional growth and development
Benefits
Medical, dental, and vision coverage
Flexible Spending Account
401k program
Competitive PTO offerings
Parental Leave
Opportunities for professional growth and development