Prolific→
Computer Sciences - Graduates - AI Training -… at Prolific · Remote
Entry LevelRemoteFull-timeRemote$125k–$125k/yr
Skills
computer scienceresearch paper interpretationalgorithm understandingcode logic reviewai model evaluationscientific reviewfact-checkingreinforcement learning from human feedbacksoftware engineeringdata scienceanalytical mindset
Job Description
Summary: Prolific is building the biggest pool of quality human data in the world. They are seeking Computer Science Specialists to join their Expert Network to help train and evaluate cutting-edge AI models by reviewing research papers and AI-generated outputs.
Responsibilities:
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human "ground truth" to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Required Qualifications:
- Educational Background: at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- Technical Literacy: ability to interpret research papers, understand complex algorithms, and review code logic
- Analytical Mindset: high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- Professional Verification: a valid LinkedIn profile to verify your degree and background during the screening process
- A PayPal account to receive payment from our clients
Required Skills: Computer Science, Research Paper Interpretation, Algorithm Understanding, Code Logic Review, AI Model Evaluation, Scientific Review, Fact-Checking, Reinforcement Learning from Human Feedback, Software Engineering, Data Science, Analytical Mindset
Benefits: Flexible hours, Ability to work from home
Benefits
Flexible hours
Ability to work from home