HYCU→
ML Infrastructure Engineer - Level 4 at HYCU · Bengaluru
Skills
Job Description
Why Join HYCU?
HYCU is the fastest-growing leader in the multi-cloud and SaaS data protection as a service industry. By bringing true SaaS-based data backup and recovery to on-premises, cloud-native, and SaaS IT environments, the company provides unrivaled data protection, migration, disaster recovery, and ransomware protection to thousands of companies worldwide. The company's award-winning R-Cloud platform eliminates complexity, risk, and the high cost of legacy-based solutions, providing data protection simplicity to make it the #1 SaaS Data Protection platform. With an industry leading NPS score of 91, HYCU has raised $140M in VC funding to date and is based in Boston, Mass. Learn more at www.hycu.com.
Overview
We are seeking a ML Infrastructure Engineer that will be responsible for designing, building, and operating the infrastructure that supports Generative AI and machine learning workloads in production. This role ensures performance, scalability, reliability, and cost efficiency of AI systems.
We are building next-generation Generative AI products that deliver actionable data insights at enterprise scale. Our platform runs large-scale AI workloads, including Large Language Models (LLMs), data pipelines, and AI agents, on modern cloud-native infrastructure. We focus on building reliable, scalable, cost-efficient, and production-grade AI infrastructure.
Location:
- Bangalore, India (Hybrid; 3 days onsite/2 days remote)
What You’ll Do:
Design and operate infrastructure for training, serving, and scaling machine learning and Generative AI models
Build and optimize model serving and inference pipelines for Large Language Models
Enable scalable experimentation, evaluation, and deployment of AI models
Implement monitoring, logging, and alerting for AI infrastructure and model performance
Collaborate with AI, data, and DevOps teams to ensure end-to-end system reliability
Design and maintain scalable infrastructure for AI and ML workloads
Optimize inference performance, resource utilization, and operational costs
Implement observability solutions for model and infrastructure health
Partner with AI engineers to productionize models and workflows
Identify infrastructure risks and drive improvements proactively
What We’re Looking For:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
6–9 years of experience in infrastructure, platform, or ML engineering roles
Experience supporting production AI or data-intensive systems at scale
Hands-on experience with cloud platforms and modern infrastructure tooling
Strong experience with cloud platforms and cloud-native infrastructure
Hands-on experience with containerization and orchestration technologies
Experience deploying and scaling ML or AI model serving systems
Strong understanding of performance optimization, cost management, and reliability engineering
Familiarity with CI/CD pipelines and infrastructure automation
Attributes of a Successful HYCUer in this role:
Self-starter and strategic thinker who thinks outside the box
Takes responsibility and ownership for driving successful outcomes. You’re results-driven with a winning attitude
Team player! You have excellent people and management skills to interact with staff, colleagues, cross-functional teams and third parties
Hands-on and builders' mentality with an entrepreneurial mindset and intrinsic motivation
Obsessed with being customer-focused – We know our customers and are advocates for their voice and point of view across HYCU
Intellectual curiosity, always open for continuous learning/growth mindset
Who We Are:
Our Core Values: Authenticity, Grit and Empathy are at the heart of everything we do at HYCU. All of us at HYCU take ownership in shaping and contributing to our culture. We pride ourselves in developing an inclusive and diverse company that supports our employees and customers to do extraordinary things.
The following is how we approach each Core Value:
Authenticity – To be authentic means to be who we are and do it well. Focus your energy on being who YOU are. Be true to yourself. Authenticity also extends to our products. Understanding where we are truly the best fit for our customers and when we are not. And finally, authenticity in relationships: ensuring that we are honest and do what we say we’re going to do.
Grit – To win we need to want it. Every team member needs to be able to jump in and help at every turn. Whether it’s staying late to help a colleague or customer or finding a better process and making sure it’s communicated cross-functionally. You just have to do it and love it…and never stop trying.
Empathy – We need to care about each other, about our clients, about our business, and about the world around us. That might seem like a tall order, but if we don’t live in a constant state of empathy, if we don’t strive to truly put ourselves in another person’s shoes, we cannot truly serve the market.
"We are at our best when we stay true to our Core Values."~ Simon Taylor, CEO
What We Offer:
Come work for one of CRN’s “Cloud 100 Companies for 2026”. At HYCU you’ll have the opportunity to build your career with a “Visionary” B2B SaaS company from Gartner’s Magic Quadrant for Enterprise BackUp. HYCU provides an excellent benefits package including Medical Insurance, generous time off, and more. We offer career development programs and an inclusive global culture. All our employees participate in our equity program.