Prolific→
Computer Sciences - Graduates - AI Training -… at Prolific · Remote
Entry LevelRemoteFull-timeRemote$125k–$125k/yr
Skills
computer scienceresearch paper interpretationalgorithm understandingcode logic reviewai model evaluationscientific reviewfact-checkingreinforcement learning from human feedback (rlhf)software engineering standardsdata science standardscode verificationlogic verificationanalytical mindset
Job Description
Summary: Prolific is building the biggest pool of quality human data in the world, utilized by AI developers and researchers. They are looking for Computer Science Specialists to join their Expert Network to train and evaluate AI models, requiring a background in CS research or technical analysis.
Responsibilities:
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human "ground truth" to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Required Qualifications:
- Educational Background: at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- Technical Literacy: ability to interpret research papers, understand complex algorithms, and review code logic
- Analytical Mindset: high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- Professional Verification: a valid LinkedIn profile to verify your degree and background during the screening process
- A PayPal account to receive payment from our clients
Required Skills: Computer Science, Research Paper Interpretation, Algorithm Understanding, Code Logic Review, AI Model Evaluation, Scientific Review, Fact-Checking, Reinforcement Learning from Human Feedback (RLHF), Software Engineering Standards, Data Science Standards, Code Verification, Logic Verification, Analytical Mindset
Benefits: Competitive pay rates, Flexible hours, Ability to work from home
Benefits
Competitive pay rates
Flexible hours
Ability to work from home