Sr Engineer - AI Agentic API Management

Description -

We are seeking an experienced engineering leader to design, build, and operate API Management layers for enterprise AI services. The role focuses on enabling secure, governed, and scalable access to managed AI services (LLMs, AI APIs, and agentic systems) through a centralized API gateway, aligned with Zero Trust principles and multi-cloud architecture.

This position plays a critical role in establishing API-first AI consumption patterns, ensuring policy enforcement, cost governance, observability, and secure integration across enterprise applications and agentic workloads.

Key Responsibilities

1. AI API Gateway Architecture & Design

• Design and implement API Management (APIM) layers to expose AI services (LLMs, search, NLP, vision) securely

• Establish northbound and southbound API patterns for external consumers and internal services

• Build gateway-based abstraction layers to decouple consumers from underlying AI providers and models

2. Zero Trust Security & Identity Enforcement

• Implement Zero Trust connectivity models for AI service exposure (identity-first, no implicit trust)

• Enforce authentication, authorization, and token validation (JWT, OAuth, managed identity)

• Integrate secure network controls such as private endpoints, NSGs, and TLS-based communication

3. Governance, Policy & Compliance

• Define and enforce API policies for:

  • Rate limiting, throttling, quota enforcement

  • Data access control and PII protection

  • Tool/API invocation governance for agentic systems

• Ensure compliance with enterprise security, audit, and regulatory standards

4. AI Service Integration & Abstraction

• Enable unified access to multi-cloud AI services (Azure AI, AWS Bedrock, etc.)

• Provide standardized API contracts and SDK patterns for application teams

• Support agent-to-service communication via gateway-controlled interfaces

5. Cost Management & Optimization

• Implement token-based and usage-based cost controls at the API gateway layer

• Enable quota allocation by project/team/API key

• Optimize usage through techniques such as caching and request deduplication

6. Observability & Reliability

• Establish end-to-end telemetry (logs, metrics, tracing) for AI API calls

• Integrate monitoring tools (App Insights / CloudWatch / Log Analytics)

• Drive SRE practices for high availability and fault tolerance

7. Platform Engineering & Automation

• Build reusable CI/CD pipelines, templates, and API onboarding frameworks

• Define “golden paths” for onboarding applications to AI services via APIs

• Automate API lifecycle management (publish, version, retire)

8. Cross-Team Collaboration

• Partner with security, platform, AI/ML, and application teams

• Guide developers on API integration with managed AI services

• Drive adoption of standardized API gateway patterns

Required Qualifications

• 10+ years of experience in API Management, Platform Engineering, or Cloud Architecture

• Bachelor’s or Master’s degree in Information Technology, Computer Science, Engineering, or a related discipline, with relevant professional experience.

• Strong experience with:

  • API gateways (Azure APIM, AWS API Gateway)

  • REST/GraphQL APIs, API lifecycle management

• Deep understanding of:

  • AI/ML service integration patterns

  • Authentication protocols (OAuth2, OIDC, JWT)

  • Zero Trust architecture principles

• Experience in cloud platforms (Azure and/or AWS)

• Hands-on experience with microservices, containers, and Kubernetes

Key Competencies

• Enterprise architecture & systems thinking

• Security-first mindset (Zero Trust)

• Strong stakeholder communication and cross-team alignment

• Problem-solving in distributed, multi-cloud environments

• Ability to define standards and drive adoption at scale

Sustainable impact is HP’s commitment to create positive, lasting change for the planet, its people, and our communities. This serves as a guiding principle for delivering on our corporate vision – to create technology that makes life better for everyone, everywhere.

HP is a Human Capital Partner – we commit to human capital development and adopting progressive workplace practices in India.

#LI-POST

Job -

Schedule -

Shift -

Travel -

Relocation -

Equal Opportunity Employer (EEO) - 

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"