Want to know if this job is worth applying to?
San Jose, California, United States
Onsite
NVIDIA is looking to hire a deeply technical, creative, and Senior AI Platform Engineer to build, support, and maintain the next generation of AI-powered enterprise products that improve engineering efficiency, data security, and power our product development. This role will give you the opportunity to collaborate with Cloud and AI/ML teams in a multifaceted and agile environment. You will be pivotal in shaping the technological future of our organization, ensuring our systems are scalable, reliable, and ready for the AI era.
What you will be doing:
Define and lead AI-native infrastructure roadmaps and cross-organizational initiatives.
Architect and scale LLM/ML infrastructure across cloud-native clusters and on-premises hardware.
Design and implement observability for infrastructure health and AI model performance.
Build LLM-aware monitoring and leverage AI to improve incident response and reduce toil.
Develop automation and tooling to ensure reliability, scalability, and developer self-services
Troubleshoot complex distributed systems, including deep Kubernetes and AI/ML scaling challenges.
Drive AI-assisted engineering practices and mentor engineers to foster an AI-first culture.
Partner with product engineering and internal business units to translate AI platform capabilities into reliable, scalable solutions that accelerate product development.
What we need to see:
10+ years in cloud, platform, or SRE roles with relevant education or equivalent experience.
Bachelors degree or equivalent experience.
Strong Python and at least one systems language (C++, Go, or Rust), with proven distributed systems debugging expertise.
Deep experience building and scaling distributed systems, including Kubernetes and bare-metal infrastructure.
Strong observability design across infrastructure and AI workloads (metrics, logging, tracing, AI quality signals).
Hands-on experience operating AI/ML platforms, including MLOps, model serving, and GPU-accelerated environments.
Experience with infrastructure and application security practices, such as identity/auth, network segmentation, supply chain security, and vulnerability management in cloud-native environments.
Practical use of AI-assisted development tools and coding agents in daily workflows.
Solid foundation in data structures, algorithms, and complexity analysis.
Excellent problem-solving, communication, and collaboration across multiple functions.
Ways to stand out from the crowd:
Deep experience with AI/ML platforms (e.g., Hugging Face, Weights & Biases, NVIDIA NIM).
Proven use of AI agents and LLM tooling to enhance observability, incident response, or developer productivity.
Experience with artifact management, AI supply chain security, or trusted model distribution systems.
Experience with AI-specific threat models (OWASP Top 10 for LLMs, model poisoning, adversarial inputs), experience with FedRAMP, SOC 2, or other compliance frameworks relevant to your environment, and red-teaming or security evaluation of LLM systems.
Strong ownership demeanor with a structured, automation-first approach.
Demonstrated impact driving AI-first engineering practices across teams.
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.