Research Scientist - Post Training at AfterQuery in San Francisco

Summary: AfterQuery builds training data and evaluation infrastructure for leading AI labs to enhance their models. They are seeking a Research Scientist to design and run experiments that demonstrate the impact of their datasets on model behavior, focusing on post-training methodologies. Responsibilities: - Run controlled SFT and RL experiments to measure the impact of our datasets on model performance - Quantify lift across capabilities (reasoning, tool use, long-horizon tasks, domain-specific workflows) - Communicate your findings with partner labs to help drive sales - Work with internal SPLs to iterate on data quality based on your results Required Qualifications: - Strong familiarity with LLM training and evaluation methodologies - Genuine obsession with how data structure, selection, and quality drive model behavior - Ability to design lightweight experiments, move fast, and extract actionable insights from messy results - Comfort working across domains (you'll touch finance, software engineering, policy, and more) - A bias toward building over theorizing - Great candidates are undergrad research or master's research (but haven't done a phd) Required Skills: LLM training, Evaluation methodologies, SFT experiments, RL experiments, Data structure analysis, Data selection, Data quality assessment, Model behavior analysis, design lightweight experiments, Extract actionable insights Benefits: Equity