Research Scientist, Societal Impacts at Anthropic in San Francisco, CA

Summary: Anthropic is a public benefit corporation dedicated to creating reliable and beneficial AI systems. The Societal Impacts Research Scientist will analyze real-world usage patterns of AI, improve model behavior, and collaborate with cross-functional teams to enhance AI safety and societal impact. Responsibilities: - Using observational tools like Clio to analyze real-world usage patterns and surface insights about how people interact with Claude - Building and running evaluations to assess Claude's behavior across key dimensions of its Constitution, such as safety and quality of advice in high-stakes situations - Partnering closely with fine-tuning, safeguards, policy, and interpretability teams to translate research insights into model improvements - Generating insights about the societal impact of Anthropic's systems and using this understanding to inform company strategy, research priorities, and policy positions - Sharing your work through research publications and external presentations, and developing tools and frameworks that make AI systems more understandable to policymakers, academics, and civil society Required Qualifications: - Experience with machine learning systems - Genuine interest in societal impacts research - Adaptability and excitement to contribute to evolving team priorities - Comfort with technical infrastructure for interfacing with models - Skilled at writing up and communicating results - Background in machine learning, data science, or another technical field that involves generating insights from complex systems - Passion for translating research insights into actionable recommendations for improving AI systems and informing policy - Bachelor's degree or an equivalent combination of education, training, and/or experience - Field of study relevant to the role as demonstrated through coursework, training, or professional experience - Minimum years of experience correlating with internal job level requirements - Willingness to relocate to San Francisco Preferred Qualifications: - Prior experience in societal impacts research - Interest in management opportunities for senior candidates Required Skills: Machine Learning, Technical Infrastructure for Model Interfacing, Observational Tools (Clio), Evaluation Design for AI Behavior, Societal Impacts Research, Data Science, Research Publication, Policy Analysis Benefits: Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this., Optional equity donation matching, Generous vacation and parental leave, Flexible working hours