Domain Expert – Others | Job ID 97285 at vraify in Remote

Vraify is hiring a Domain Expert – Others to evaluate and improve advanced AI systems across broad professional and knowledge domains.

Location: Remote worldwide in greenlit locations, excluding the United States.
Contract: Independent contractor assignment for 8 weeks; immediate start.
Pay: $20 per completed task (average handling time: 3 hours per task). A $150 flat partner fee is paid after 2 weeks of active engagement.
Commitment: Full-time, 40 hours per week, with at least 4 hours of Pacific Time overlap.

What you will do
• Create prompts and evaluation tasks across your area of expertise and other real-world domains.
• Review AI-generated answers for accuracy, reasoning quality, completeness, relevance, and nuance.
• Identify hallucinations, contradictions, outdated information, and edge cases.
• Create benchmark examples and challenging test cases that improve model quality.
• Provide clear, evidence-based feedback and reliable references.
• Collaborate with AI researchers and maintain consistent annotation quality and documentation.

What you bring
• Master’s degree or equivalent expertise in a relevant discipline.
• 3+ years of professional, research, teaching, or domain experience.
• Excellent written English, analytical skills, and attention to detail.
• Comfort working with LLMs, generative AI, prompt engineering, or AI evaluation is preferred.

Shortlisted applicants will receive a job interest form.