AI Prompt Developer at DoubleVerify in NYC Global HQ

Summary: DoubleVerify is a leading software platform for digital media measurement, data and analytics. They are seeking an AI Prompt Developer to convert complex content policies into concise prompts for LLMs, ensuring alignment with business needs and contributing to prompt development methodologies. Responsibilities: - Test, refine, and document changes based on performance metrics and stakeholder feedback - Contribute to prompt development methodologies and evaluation frameworks - Collect qualitative and quantitative data, performing root-cause analyses on misclassifications - Report findings through clear, structured communication (charts, written reports, demos) - Partner with Policy, Legal, and Data Science teams to ensure prompt accuracy and alignment - Identify gaps in policies and offer data-driven recommendations - Document best practices and contribute to a centralized knowledge base Required Qualifications: - Bachelor's degree or equivalent experience in fields such as Policy, Linguistics, Communications, Social Sciences, Business, or STEM - Excellent written and communication skills, with the ability to simplify the complex for diverse audiences - Highly analytical with an understanding of established research methodologies - Ability to interpret large data sets, identify trends or errors, and propose solutions - Comfortable using spreadsheets, BI tools, or basic scripting to conduct data analyses - Comfortable working closely with global teams across timezones - Able to adjust to shifting priorities, and propose actionable solutions in ambiguous scenarios Preferred Qualifications: - 1-2 years experience in roles dealing with technical writing, content moderation, policy analysis, data analytics, or research assistance - You have a foundational grasp of AI/ML concepts (especially LLMs) and are open to learning new tools - Knowledge of software for data visualization (Tableau, Looker, Power BI) - Experience with academic or industry publications or collaborative research projects Required Skills: AI/ML concepts, Large Language Models (LLMs), Content policy interpretation, Data analysis, Spreadsheets, Business Intelligence tools, Data visualization Tableau, Data visualization Looker, Data visualization Power BI, Content moderation, Policy analysis, Research methodologies, Root-cause analysis Benefits: Bonus/commission (as applicable), Equity, Benefits