Prolific→
Computer Sciences - Graduates - AI Training -… at Prolific · Remote
Entry LevelRemoteFull-timeRemote$125k–$125k/yr
Skills
computer sciencetechnical literacyresearch paper interpretationalgorithm understandingcode logic reviewanalytical mindsetai evaluationscientific reviewfact-checkingreinforcement learning from human feedbackcode verificationgenerative ailarge language modelsverification frameworks
Job Description
Summary: Prolific is a leading company in the AI space, focused on building a vast pool of quality human data for AI development. They are seeking Computer Science Specialists to join their Expert Network to help train and evaluate AI models by comparing AI-generated responses, reviewing research papers, and providing human feedback.
Responsibilities:
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human 'ground truth' to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Required Qualifications:
- Educational Background: at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- Technical Literacy: ability to interpret research papers, understand complex algorithms, and review code logic
- Analytical Mindset: high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- Professional Verification: a valid LinkedIn profile to verify your degree and background during the screening process
- A PayPal account to receive payment from our clients
Required Skills: Computer Science, Technical Literacy, Research Paper Interpretation, Algorithm Understanding, Code Logic Review, Analytical Mindset, AI Evaluation, Scientific Review, Fact-Checking, Reinforcement Learning from Human Feedback, Code Verification, Generative AI, Large Language Models, Verification Frameworks
Benefits: Flexible hours, The ability to work from home
Benefits
Flexible hours
The ability to work from home