Prolific→
Computer Sciences - Graduates - AI Training -… at Prolific · Remote
Entry LevelRemoteRemote$125k–$125k/yr
Skills
computer scienceresearch paper interpretationalgorithm understandingcode logic reviewai evaluationscientific reviewfact-checkingreinforcement learning from human feedbacksoftware engineeringdata scienceanalytical mindset
Job Description
Summary: Prolific is building the biggest pool of quality human data in the world. They are seeking Computer Science Specialists to join their Expert Network to help train and evaluate cutting-edge AI models, involving tasks such as AI evaluation, scientific review, and fact-checking.
Responsibilities:
- AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
- Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
- Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
- RLHF (Reinforcement Learning from Human Feedback): providing the human 'ground truth' to help models align with professional standards in software engineering and data science
- Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness
Required Qualifications:
- at minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
- ability to interpret research papers, understand complex algorithms, and review code logic
- high level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
- a valid LinkedIn profile to verify your degree and background during the screening process
- A PayPal account to receive payment from our clients
Required Skills: Computer Science, Research Paper Interpretation, Algorithm Understanding, Code Logic Review, AI Evaluation, Scientific Review, Fact-Checking, Reinforcement Learning from Human Feedback, Software Engineering, Data Science, Analytical Mindset
Benefits: Competitive pay rates, Flexible hours, The ability to work from home
Benefits
Competitive pay rates
Flexible hours
The ability to work from home