Machine Learning - Annotation and Gen AI Analyst… at CCC… · Remote

Summary: CCC Intelligent Solutions is a leading cloud platform for the multi-trillion-dollar insurance economy, creating intelligent experiences for various stakeholders. The role involves working with annotation pipelines, quality analysis, and Gen AI products, providing hands-on experience in a corporate setting. Responsibilities: - Own pipelines to aggregate, reconcile, and validate annotation outputs from a team of 4–6 annotators; define and enforce schemas, rules, and consistency checks - Design and run quality metrics (e.g., inter-annotator agreement, error rates, coverage); identify systematic issues and recommend process and guideline improvements - Support Gen AI initiatives by curating and validating training or evaluation data, defining quality criteria, and contributing to evaluation and monitoring - Raise standards in documentation, runbooks, and workflows; improve traceability and reproducibility of annotation and validation steps Required Qualifications: - Strong quantitative or analytical background (e.g., degree in computer science, math, statistics, engineering, or related field) - Solid programming skills, preferably in Python - Comfort with Git, Jira, and cloud (e.g., AWS) - Ability to drive clear documentation and process improvements Preferred Qualifications: - Experience with data validation, quality metrics, or annotation workflows Required Skills: Python Important Skills: Data validation, Quality metrics, Git, AWS, SQL Nice-to-Have Skills: Analytical skills Benefits: 401K Match, Paid time off, Annual Incentive Plan Performance Bonus, Comprehensive health insurance, Adoption Assistance, Tuition Reimbursement, Wellness Programs, Stock Purchase Plan options, Employee Resource Groups