Research Scientist, Societal Impacts at Anthropic in San Francisco, CA

Summary: Anthropic is a public benefit corporation focused on creating reliable and interpretable AI systems. They are seeking a Societal Impacts research scientist to analyze AI behavior and improve model performance through collaboration with various teams. Responsibilities: - Using observational tools like Clio to analyze real-world usage patterns and surface insights about how people interact with Claude - Building and running evaluations to assess Claude's behavior across key dimensions of its Constitution, such as safety and quality of advice in high-stakes situations - Partnering closely with fine-tuning, safeguards, policy, and interpretability teams to translate research insights into model improvements - Generating insights about the societal impact of Anthropic's systems and using this understanding to inform company strategy, research priorities, and policy positions - Sharing your work through research publications and external presentations, and developing tools and frameworks that make AI systems more understandable to policymakers, academics, and civil society Required Qualifications: - At least a Bachelor's degree in a related field or equivalent experience - Experience working with machine learning systems - Genuine interest in societal impacts research - Adaptable and collaborative, able to take direction and contribute to team priorities - Skilled at writing up and communicating results, even when they're null or unexpected - Background in machine learning, data science, or another technical field that involves generating insights from complex systems - Passionate about translating research insights into actionable recommendations for improving AI systems and informing policy - For senior candidates: willingness to do hands-on work while also helping shape research direction Preferred Qualifications: - Prior experience in societal impacts research - Interest in management opportunities down the line Required Skills: Machine learning systems, Societal impacts research Important Skills: Data science, Technical infrastructure Nice-to-Have Skills: Collaboration, Communication skills Benefits: Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this., Optional equity donation matching, Generous vacation and parental leave, Flexible working hours