Research & Development Intern-LLM, Summer 2026

Summary: Walt Disney Imagineering is the creative development and engineering arm of The Walt Disney Company, focusing on innovation in the entertainment industry. They are seeking a Research and Development Intern to help design and evaluate custom metrics for large language models and agentic systems, contributing to the efficiency of Imagineering teams. Responsibilities: - Help design and develop custom evaluation metrics for LLM and agentic systems - Verify those new metrics on existing datasets - Assist in design and setup of experimental data collection efforts for new datasets - Validate human perception of said custom metrics, using existing datasets or designing playtests to collect perceptions - Document and develop software for running the custom eval metric(s) in larger systems - Understand and engage with the broad technical and creative goals of the project - Help define milestones that solve important technical issues and convey the potential impact of the project - Engage in team brainstorms and troubleshooting Required Qualifications: - Experience with LLMs - Experience with agentic systems - Experience with LLM evaluation metrics - Python coding skills - Previous experience with experiment design and data analysis - Currently enrolled in a master's program from an accredited college/university, earning a degree in Computer Science or Generative AI - Be enrolled in an accredited college/university pursuing a degree taking at least one class at time of application posting OR currently participating in a Disney College Program or Disney Internship - Be at least 18 years of age - Possess unrestricted work authorization - Have not completed one year of continual employment on a Disney internship or Disney College Program - Able to have a consistent, reliable work schedule throughout the internship - Fully available from Monday through Friday for the duration of the internship, 40 hours each week - Able to provide own housing for the duration internship program in the Glendale, CA area - Able to provide/have reliable transportation to/from work Preferred Qualifications: - Experience with Pytorch Required Skills: LLMs, agentic systems, LLM evaluation metrics Important Skills: Python coding skills, Experiment design, Data analysis Nice-to-Have Skills: Pytorch Internship Start Date: Start in 2026 Summer Benefits: Medical, Financial, Other benefits