Principal Engineer - SRE

About the Role and the Team 

Arcesium seeks an exceptional engineer to join our Infrastructure team and provide expert-level technical leadership for our front-office Portfolio and Order Management System recently integrated into the Arcesium product suite.

This is a hands-on individual contributor role that owns the architectural direction for our most complex site reliability challenges and will be responsible for:

1. Reliability, scalability, and operational maturity of a Kubernetes-native, AWS-hosted platform.
2. High availability, disaster recovery, observability across components and client pods
3. Troubleshooting live production issues with a deep focus on rapid incident resolution, creating RCA and building tools that enhance system stability and resilience.
4. Bringing strong opinions on how infrastructure should be run - backed by experience running large-scale production systems.

What You Will Do

• Own the reliability and availability of core platform infrastructure including Kubernetes clusters, ArgoCD deployments, PostgreSQL databases, and supporting AWS services
• Plan and execute infrastructure maintenance - upgrades, patching, and validation of platform components with zero-to-minimal client impact
• Improve CI/CD pipelines and developer tooling, including migration of locally executed Terraform apply processes to automated, auditable workflows
• Build and enhance infrastructure monitoring, alerting, and observability to reduce mean time to detection and resolution
• Evaluate and adopt new infrastructure tooling and capabilities (service mesh, cost optimization, capacity planning) that improve reliability and scalability.
• Contribute to the convergence of Limina infrastructure with Arcesium's broader infrastructure ecosystem, supporting standardization of tooling, networking, security, and operational best practices
• Establish and participate in on-call rotations, building sustainable operational coverage across global time zones as the client base grows
• Troubleshoot and resolve complex cross-system issues spanning application, infrastructure, and cloud layers
• Write and review infrastructure-as-code, automation scripts, and internal tooling
• Lead by example with exemplary code, design documents, RFC's, runbooks, system and architecture design documents and documenting operational procedures to build institutional knowledge

What You Will Need

• A bachelor’s or master’s degree in computer science, Engineering, or a related field with 9+ years of professional engineering experience, including significant time in a principal-level or equivalent individual contributor role.
• Hands-on experience in site reliability engineering, infrastructure engineering, DevOps, or platform engineering roles
• Strong track record of owning and operating production Kubernetes environments (cluster lifecycle, networking, storage, RBAC, troubleshooting)
• Hands-on experience running critical workloads on AWS (EC2, EKS, RDS, IAM, VPC, S3, CloudWatch, and related services)
• Experience with observability platforms (Datadog, Prometheus, Grafana, ELK), modern alerting design, infrastructure-as-code (Terraform, CloudFormation), and CI/CD pipelines (GitLab CI, Jenkins).
• Strong programming and scripting ability in Python; familiarity with Bash, Go, or Java is a plus
• Experience with GitOps-based deployment workflows (ArgoCD, FluxCD, or similar)
• Familiarity with PostgreSQL or similar relational databases in a production context - backup, recovery, upgrades, and performance tuning
• Demonstrated experience with on-call rotations, incident management, and post-incident review processes
• A proven track record designing and delivering large-scale reliability initiatives (HA/DR, observability, automation platforms) with measurable outcomes.

Arcesium's Personal Data Privacy Notice for Candidates is linked here.