Engineer, LLM Ops

Do you want to shape the future of fintech and healthtech? Energized by challenges and inspired by bold goals? Ready to elevate your career alongside driven and talented colleagues? If that sounds like you, explore a career at Alegeus today. Opportunity Happens Here. 

Engineer, LLM Ops

Join our team at Alegeus, where you’ll experience unmatched opportunity and a culture that cares deeply about succeeding together. As an Engineer, LLM Ops, you’ll play a critical role in enabling governed, scalable, and high-quality AI adoption—driving how LLM-powered solutions are deployed, monitored, and continuously improved across the enterprise. Collaborate with dedicated colleagues, embrace a spirit of innovation, and build an enriching career with us.

OPPORTUNITY HAPPENS HERE — REALIZE YOURS

Alongside the best and the brightest, you will regularly:

• Shape the future of AI operations by building and evolving LLMOps practices that drive reliable, secure, and scalable deployment of AI-powered solutions.

• Lead the operational excellence of generative AI by managing prompt lifecycles, model configurations, and evaluation workflows that ensure consistent, high-quality outcomes.

• Drive innovation with responsible AI rollout strategies, leveraging A/B testing, feature flags, and human-in-the-loop processes to safely bring new capabilities to production.

• Elevate AI performance and quality through advanced monitoring, evaluation frameworks, and continuous feedback loops that improve accuracy, cost-efficiency, and user experience.

• Champion governed AI adoption by embedding auditability, traceability, and compliance into every stage of the LLM lifecycle.

• Collaborate cross-functionally with AI engineers, data scientists, platform teams, and business stakeholders to transform cutting-edge AI prototypes into production-ready solutions.

ESSENTIAL SKILLS FOR CREATING A LASTING IMPACT

Alegeus colleagues are known as problem-solvers, risk-takers, and innovative thinkers. As an Engineer, LLM Ops, these skills are essential for success:

• Abilities: Strong problem-solving and collaboration skills with the ability to operationalize LLMOps practices—including prompt lifecycle management, evaluation, observability, governance, and secure AI deployment—across cross-functional teams.

• Experience: 3+ years in LLMOps, AI operations, software engineering, DevOps, cloud engineering, MLOps, or related roles, with hands-on exposure to generative AI (LLMs, prompts, RAG, embeddings) and experience with Azure OpenAI or similar platforms, CI/CD tools (Azure DevOps, GitHub Actions), and programming in Python or C#/.NET.

• Education: Bachelor’s degree or equivalent experience in a relevant field (e.g., computer science, engineering, or related discipline).

• Location: Bangalore, India

BECAUSE WE CARE, WE OFFER: 

We are committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, age, physical or mental disability, veteran or military status, genetic information, sexual orientation, marital status, or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances. The information collected by this application is solely to determine suitability for employment, verify identity and maintain employment statistics on applicants.

At Alegeus, being transparent about our compensation philosophy and approach is more than just a legal requirement. As our organization continues to grow and evolve, we have made a commitment to ensure that our compensation framework is equitable, data-driven, consistent, and unbiased, with allowable pay differences based on factors unique to each candidate (think: skills, experience, qualifications, etc.) in order to attract and retain a highly talented and committed workforce.

We are taking an “inside-out” approach to pay transparency by first educating our valued managers and internal workforce and then moving to publishing compensation ranges externally.  In the interim, if you are a California, Colorado, Connecticut, Maryland, Nevada, New Jersey, New York, Ohio or Washington resident and this role is physically available in your state or classified as remote, you may be eligible to receive additional information about the compensation and benefits for this role, which we will provide upon request. Please send an email identifying the title of the role you are interested in and the state you reside in to talentacquisitionteam@alegeus.com.

Alegeus may use AI technology during candidate interviews. The uses include recording, note-taking, and summarizing candidate interviews. The information generated by the AI technology will be used by Alegeus during the hiring process. If you wish to opt out of having AI technology transcribe your interview, please notify your recruiter in advance of the interview. Otherwise, by agreeing to an interview with us, you consent to the use of AI technology during your interview.