United States
Onsite
Not Available
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Technical Architect – Platform Engineering based in United States .
The Technical Architect – Platform Engineering will design, build, and optimize high-performance infrastructure supporting advanced Generative AI and large language model workloads. This senior technical role focuses on GPU-accelerated computing, distributed training, and scalable platform engineering across cloud and on-premises environments. You will help establish the infrastructure foundations required to develop, fine-tune, deploy, and operate production-grade AI solutions. Working alongside architects and specialists in data engineering, software engineering, machine learning, and MLOps, you will translate complex technical requirements into reliable, scalable platforms. The role combines deep hands-on engineering with architectural leadership, client collaboration, and technical mentorship. You will also contribute to innovation initiatives and help shape infrastructure practices, automation, and platform capabilities for enterprise AI solutions.
Platform Architecture & Infrastructure Engineering
Design, implement, and scale infrastructure for LLM and Generative AI workloads across multi-GPU environments.
Architect high-performance compute platforms for distributed training, model fine-tuning, inference, and production deployments.
Build and maintain container hosting platforms using Kubernetes and Red Hat OpenShift.
Design scalable cloud and on-premises infrastructure to support demanding AI and machine learning workloads.
Introduce new cloud technologies, tools, and processes to improve platform capabilities and deliver greater business value.
GPU Performance & Distributed Computing
Conduct GPU profiling, benchmarking, troubleshooting, and performance optimization for distributed training workloads.
Manage and schedule compute-intensive workloads using Slurm-based clusters and OpenShift/Kubernetes environments.
Enable and optimize the NVIDIA GPU ecosystem, including CUDA, cuDNN, NCCL, Nsight, Triton, TensorRT, and RAPIDS.
Optimize Linux systems, multi-GPU configurations, and compute environments to improve performance, reliability, and resource utilization.
Generative AI & MLOps Enablement
Build and support Generative AI pipelines, including LLM fine-tuning, retrieval-augmented generation (RAG), multimodal inference, and LLMOps.
Collaborate with data science, MLOps, application engineering, and architecture teams to deploy models in research and production environments.
Support integration between AI workloads, model-serving infrastructure, vector databases, and retrieval systems.
Help establish reliable platform foundations for enterprise AI applications and production-grade deployments.
Automation, Infrastructure as Code & DevOps
Develop reusable infrastructure templates and deployment patterns using Terraform, Helm, Ansible, and related tools.
Champion Infrastructure as Code (IaC) adoption and promote automation-first engineering practices.
Develop automation software that improves the functionality, reliability, availability, and manageability of applications and cloud platforms.
Design self-service and self-healing platforms, including synthetic monitoring, alerting, and operational tooling.
Automate development and testing processes through CI/CD pipelines using technologies such as Git, Jenkins, SonarQube, Artifactory, and Docker.
Continuously improve platform operations, deployment processes, and infrastructure management practices.
Technical Leadership & Client Collaboration
Lead technical discussions around architecture design, infrastructure decisions, and troubleshooting.
Engage with clients to understand technical requirements, recommend solutions, and proactively address implementation challenges.
Mentor senior technical resources and team leads, sharing expertise and promoting engineering best practices.
Contribute to internal innovation through proof-of-concept initiatives, technical workshops, and knowledge-sharing activities.
Support client-facing delivery engagements and collaborate with cross-functional teams to ensure successful implementation.
8+ years of relevant professional experience in platform engineering, infrastructure architecture, cloud engineering, or high-performance computing.
Strong practical experience with Slurm and distributed training environments.
Hands-on expertise with Red Hat OpenShift and/or Kubernetes, including container orchestration and platform deployment.
Deep knowledge of the NVIDIA GPU ecosystem, including CUDA, cuDNN, NCCL, Nsight, Triton, and/or TensorRT.
Strong foundation in Linux systems administration, performance tuning, and multi-GPU optimization.
Demonstrated experience deploying Generative AI workloads, including LLM fine-tuning, RAG pipelines, and multimodal systems.
Familiarity with Infrastructure as Code tools such as Terraform and Ansible.
Experience working with cloud GPU environments, including GCP, AWS, Azure, or OCI, and/or on-premises GPU clusters.
Ability to lead technical architecture discussions, evaluate infrastructure options, and provide practical solutions to complex engineering challenges.
Experience mentoring senior engineers, technical specialists, or team leads.
Strong troubleshooting, analytical, and problem-solving capabilities, particularly in distributed and performance-intensive environments.
Effective communication and collaboration skills, with the ability to work across engineering disciplines and engage confidently with clients.
Additional valuable qualifications:
Experience with NVIDIA NIMs, DGX systems, or GPU-accelerated containers.
Knowledge of LLMOps frameworks and MLOps integration practices.
Familiarity with vector databases and retrieval technologies used in RAG architectures.
Experience working in client-facing technical consulting or enterprise AI solution delivery environments.
Healthcare domain experience is an advantage:
Familiarity with FHIR R4, HL7 v2, or SMART on FHIR standards.
Experience integrating with Electronic Health Record (EHR) systems, such as Epic.
Understanding of HIPAA requirements and healthcare data privacy.
Exposure to clinical workflows, CDS Hooks, or patient-facing applications.
Experience developing clinical decision support systems or healthcare interoperability solutions.
Remote working opportunity for candidates based in Canada.
Full-time employment opportunity.
Exposure to advanced technologies across Generative AI, machine learning, cloud infrastructure, GPU computing, and data engineering.
Opportunities to work on complex enterprise transformation projects for major global organisations.
Professional development and continuous learning through challenging technical assignments and collaboration with experienced specialists.
Opportunities to contribute to research-focused innovation initiatives, including proof-of-concept projects and technical workshops.
Exposure to a broad technology ecosystem, including leading cloud, AI, and GPU platforms.
Opportunity to mentor technical teams, influence architecture decisions, and develop senior technical leadership capabilities.
Collaborative, international working environment built around transparency, diversity, integrity, learning, and professional growth.