AI Engineer at ARCO Design/Build in White Plains, NY

ABOUT YOU:

Are you energized by the opportunity to build and scale AI solutions that create real business impact? Do you thrive at the intersection of software engineering, machine learning, and emerging generative AI technologies? If so, we have an exciting opportunity for you at ARCO, a Family of Construction Companies.

 

We are looking for an AI Technical Engineer to help design, develop, and deploy enterprise-grade AI and large language model (LLM) solutions across our organization. This individual will play a key role in advancing our AI strategy by building intelligent applications, enhancing operational efficiency, and identifying innovative ways to leverage AI throughout the business.

WHAT WE CAN OFFER YOU:

We are dedicated to the well-being of our associates and are proud to be consistently recognized as a Best Place to Work. Our compensation and benefits package not only supports our associates and their families but benefits local communities and communities around the world.

• Industry-leading performance-based bonus program
• ESOP
• Traditional and Roth 401k
• Tuition reimbursement for associates
• Scholarship for associates’ children up to $28,000 per child
• 1-month paid sabbatical after every five years of employment, plus $5,000 for travel
• 1-week paid volunteer leave each year
• 100% charitable match
• Medical, dental, and vision insurance coverage
• 100% paid 12-week maternity leave

At ARCO, our first core value is to treat people fairly and do the right thing. We are committed to building and sustaining a culture that supports diversity and inclusion. We are proud to be an equal opportunity employer, and all qualified applicants will receive consideration for employment.

From recruiting, training, and hiring practices to selecting our subcontractors, we understand that diversity of all those involved in the construction process enhances our ability to deliver the best solutions to our customers. We hire the best and the brightest from across the country – constructing a team of experts in architecture, design, engineering, project management, and business services.

A DAY IN THE LIFE:

• Design, build, and deploy AI-driven applications and services
• Develop generative AI solutions using large language models (LLMs) via Azure OpenAI Service
• Implement use cases such as chatbots, copilots, document summarization, knowledge search, and workflow automation
• Apply prompt engineering, grounding, and retrieval-augmented generation (RAG) techniques
• Evaluate LLM outputs for accuracy, safety, and performance
• Build, train, and evaluate models using Azure Machine Learning
• Work with structured and unstructured data to support AI and LLM-based solutions
• Perform data preprocessing, feature engineering, and model tuning
• Manage model lifecycle, versioning, and prompt iteration strategies
• Monitor model and LLM performance, usage, and cost; optimize as needed
• Implement CI/CD pipelines using Azure DevOps or GitHub
• Document models, prompts, and system architecture clearly
• Translate business needs into scalable technical solutions
• Work with cross-functional teams to identify AI and LLM opportunities
• Deploy and manage AI/LLM solutions in Azure environments
• Build scalable applications using Azure Functions, Azure App Service, or containers
• Integrate AI capabilities into enterprise systems and Microsoft tools (e.g., Teams, SharePoint, Power Platform)
• Develop backend services and APIs to support AI/LLM applications

NECESSARY QUALIFICATIONS:

• Bachelor’s degree in Computer Science, Engineering, or related field
• 2–5+ years of experience in software development, AI, or machine learning
• Strong programming skills in Python / Microsoft full-stack development
• Experience building APIs and backend services
• Hands-on experience or strong familiarity with large language models (LLMs) and generative AI concepts
• Experience working in a cloud environment (Azure preferred)
• Experience building applications using Azure OpenAI Service
• Knowledge of LLM techniques such as prompt engineering, RAG, embeddings, and vector search (e.g., Azure AI Search)
• Experience integrating AI into Microsoft ecosystem tools (Teams, SharePoint, Power Platform)
• Familiarity with containerization (Docker) and orchestration (Kubernetes)
• Experience with secure, enterprise-grade AI deployment

LEGAL DISCLAIMER:

EOE, including disability/vets