Prolific→
Computer Sciences - Graduates - AI Training -… at Prolific · Remote
Entry LevelRemoteRemoteUp to $125k/yr
Skills
computer scienceresearch paper interpretationalgorithm understandingcode logic reviewtechnical analysisai model evaluationscientific reviewfact-checkingreinforcement learning from human feedback (rlhf)software engineering standardsdata science standards
Job Description
Summary: Prolific is building the biggest pool of quality human data in the world. They are seeking Computer Science Specialists to join their Expert Network to help train and evaluate cutting-edge AI models.
Responsibilities:
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human "ground truth" to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Required Qualifications:
- Educational Background: at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- Technical Literacy: ability to interpret research papers, understand complex algorithms, and review code logic
- Analytical Mindset: high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- Professional Verification: a valid LinkedIn profile to verify your degree and background during the screening process
- A PayPal account to receive payment from our clients
Required Skills: Computer Science, Research Paper Interpretation, Algorithm Understanding, Code Logic Review, Technical Analysis, AI Model Evaluation, Scientific Review, Fact-Checking, Reinforcement Learning from Human Feedback (RLHF), Software Engineering Standards, Data Science Standards
Benefits: Competitive pay rates, Flexible hours, The ability to work from home
Benefits
Competitive pay rates
Flexible hours
The ability to work from home