Prolific→
Computer Sciences - Graduates - AI Training -… at Prolific · Remote
Entry LevelRemoteFull-timeRemote$125k–$125k/yr
Skills
computer scienceresearch paper interpretationalgorithm understandingcode logic reviewai model evaluationscientific reviewfact-checkingreinforcement learning from human feedback (rlhf)code verificationlogic verificationgenerative ailarge language models (llms)analytical mindset
Job Description
Summary: Prolific is building the biggest pool of quality human data in the world. They are seeking Computer Science Specialists to join their Expert Network to help train and evaluate cutting-edge AI models by reviewing research papers and AI-generated content for accuracy and integrity.
Responsibilities:
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human "ground truth" to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Required Qualifications:
- at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- ability to interpret research papers, understand complex algorithms, and review code logic
- high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- a valid LinkedIn profile to verify your degree and background during the screening process
- a PayPal account to receive payment from our clients
Required Skills: Computer Science, Research Paper Interpretation, Algorithm Understanding, Code Logic Review, AI Model Evaluation, Scientific Review, Fact-Checking, Reinforcement Learning from Human Feedback (RLHF), Code Verification, Logic Verification, Generative AI, Large Language Models (LLMs), Analytical Mindset
Benefits: Competitive pay rates, Flexible hours, The ability to work from home
Benefits
Competitive pay rates
Flexible hours
The ability to work from home