LLMops Engineer

Start free →

Or apply yourself on the official page →

About the role

About Coursera + Udemy Coursera and Udemy are now one company, bringing together two mission-driven brands to create the world’s most powerful platform for turning learning into progress. Together, we help more than 300 million learners and 12,000+ enterprise customers build the skills they need for a world being reshaped by AI. Read more about the combined company by visiting our blog . Why join us now? AI is transforming how people learn, work, and grow, and the need for new skills has never been greater. Coursera brings trusted content and credentials from leading university and industry partners, while Udemy brings a dynamic skills marketplace and global network of real-world experts. By combining these strengths, we can connect more people and organizations to the skills they need, when they need them. Shape what comes next By joining our team, you’ll have the opportunity to reshape how the world learns and applies skills—and help millions of people participate in the new economy. Bring your ideas, expertise, and perspective to meaningful work that can make a difference at global scale. About the Team (Job Location - Pune) : As an AI Platform and LLMOps Engineer, you will join a fast-paced innovation team at Coursera working on AI enablement for our organization and customers. As an internal focus area, this team builds and maintains the infrastructure & tooling required to drive meaningful AI adoption across the organization, providing a platform for non-technical team members to build and deploy tools and transforming entire business functions into AI-native operating models. As a customer-facing focus area, this team builds custom AI-powered solutions tailored for our enterprise customers supporting them in their journey of AI adoption and upskilling beyond just the content on our platforms. You will own the operational backbone that lets our agentic AI systems run reliably in production — from prompt and pipeline versioning to evaluation, monitoring, incident and cost management. You will work closely with a cross-functional team of Software Engineers, AI Specialists and Product Managers – helping turn promising AI prototypes into reliable, observable, and cost-effective production systems. Key Responsibilities • Build and maintain the operational tooling for our LLM-powered systems, including prompt/pipeline versioning, evaluation harnesses, and CI/CD workflows tailored to non-deterministic AI outputs • Implement monitoring and observability for production LLM systems — tracking latency, token usage, cost per request, output quality, and drift over time • Design and run automated evaluation suites to catch regressions, hallucinations, and quality degradation before they reach customers • Manage RAG pipelines and vector store infrastructure, keeping retrieval sources fresh, accurate, and performant • Implement safety and compliance guardrails — content filtering, PII redaction, and access controls — in line with enterprise data privacy and residency requirements • Own cost governance for LLM usage: caching strategies, model routing, and usage reporting to keep spend predictable as adoption scales • Collaborate closely with Product Managers and Senior Engineers to scope operational requirements and translate them into reliable systems • Participate in sprint planning, technical grooming, and retrospective discussions Education • Bachelor’s or Master’s degree in Computer Science, Computer Engineering or a related field Basic Qualifications • 4+ years of experience in a software engineering role, with a solid background in Backend Engineering and DevOps fundamentals • Hands-on experience operating or supporting LLM-powered systems in production (via APIs, RAG pipelines, frontier/open weight/fine-tuned m

View the official posting →