Overview
Responsible for designing, implementing, and continuously improving highly reliable, scalable, and resilient platform solutions across the enterprise. Operates as a subject matter expert (SME) in Site Reliability Engineering, driving reliability engineering practices, operational excellence, observability, testing, and automation across the Software Development Lifecycle. Leads complex initiatives, influences enterprise engineering standards, and partners with senior stakeholders to improve system stability, resiliency, performance, and operational maturity. Serves as a mentor and technical leader for less experienced engineers across Technology.
Primary Responsibilities
- Accountable for defining and driving service reliability standards, including SLOs, SLAs, SLIs, and error budgets across platforms.
- Design and implement highly available, fault-tolerant architectures aligned with enterprise scalability and resiliency requirements.
- Lead initiatives to improve system reliability, availability, performance, and operational excellence through automation and engineering best practices.
- Develop and promote observability strategies leveraging logging, monitoring, alerting, distributed tracing, OpenTelemetry (OTel), Dynatrace, dashboards, and telemetry analytics.
- Design and maintain end-to-end monitoring solutions that provide actionable insights into application, infrastructure, and customer experience health.
- Analyze production telemetry to proactively identify performance bottlenecks, reliability risks, and capacity constraints.
- Lead incident management practices, including detection, response, escalation, recovery, and coordination of high-severity production events.
- Drive problem management and Root Cause Analysis (RCA) activities to prevent systemic issues and ensure corrective actions are implemented.
- Lead automation initiatives for self-healing systems, operational workflows, deployments, recovery procedures, and reliability controls.
- Partner with development teams to build reliable, observable, and scalable services throughout the Software Development Lifecycle (SDLC).
- Design, develop, and execute automated regression testing strategies to validate application stability, reliability, and performance following deployments and infrastructure changes.
- Review test coverage and reliability validation approaches to ensure comprehensive testing and risk mitigation.
- Create, maintain, and improve Infrastructure as Code (IaC) solutions using Terraform for infrastructure provisioning, configuration management, and environment standardization.
- Support and optimize cloud environments, including Microsoft Azure services, deployment automation, scaling strategies, and application lifecycle management.
- Utilize cloud-native monitoring and operational tools to improve platform visibility, reliability, and performance.
- Serve as a technical authority for performance engineering, resilience, capacity planning, and workload optimization.
- Drive production readiness practices, including performance testing, resiliency testing, failover validation, disaster recovery preparedness, and operational readiness reviews.
- Review architectural designs and technical roadmaps, providing recommendations to improve reliability, scalability, resiliency, and operational efficiency.
- Lead cross-team reliability improvement initiatives and influence enterprise engineering standards.
- Develop and maintain operational runbooks, incident playbooks, knowledge articles, and standard operating procedures.
- Partner with development, infrastructure, cybersecurity, architecture, and support teams to identify risks, drive continuous improvement, and optimize platform performance.
- Participate in and lead post-incident reviews, ensuring actionable outcomes and measurable improvements.
- Communicate system health, reliability trends, operational risks, and remediation strategies to technical and business stakeholders.
- Present reliability initiatives, operational metrics, and engineering recommendations in architecture reviews, technical forums, and leadership discussions.
- Mentor engineers on reliability engineering, observability, cloud engineering, automation, and operational best practices.
- Engage with stakeholders to identify risks, dependencies, and optimization opportunities.
- Ensure adherence to risk and regulatory standards and escalate issues when needed.
- Promote an environment that supports a culture of belonging and reflects the M&T Bank brand.
- Maintain internal control standards, including timely implementation of audit findings, regulatory requirements, and compliance expectations.
- Complete other related duties as assigned.
Scope of Responsibilities
Applies expert-level Site Reliability Engineering practices across multiple platforms. Drives enterprise-wide reliability improvements and influences technical direction without direct authority. Provides technical leadership, mentorship, and guidance to engineers and project teams.
Supervisory/Managerial Responsibilities
No supervisory responsibilities.
Education and Experience Required
Associate’s degree and a minimum of 9 years’ systems analysis and/or application development work experience or Bachelor’s degree and a minimum of 7 years’ systems analysis and/or application development work experience. In lieu of a degree, a combined minimum of 11 years’ education and/or relevant work experience, including a minimum of 7 years’ systems analysis and/or application development work experience.
Expert experience in system design, reliability engineering, and production operations.
Advanced proficiency in at least one programming or scripting language.
Education and Experience Preferred
- Experience with observability and incident management tooling.
- Experience with cloud platforms such as AWS or Azure.
- Strong understanding of CI/CD, DevOps, and SDLC practices.
- Experience defining and implementing SLO/SLI frameworks.
- Experience in regulated environments such as financial services.
- Strong communication and stakeholder management skills.
- Experience with Infrastructure as Code (IaC), including Terraform.
- Experience with monitoring and observability platforms such as Dynatrace, OpenTelemetry, Azure Monitor, Application Insights, or similar tools.
- Experience with automated testing, deployment automation, and reliability engineering practices.
- Knowledge of capacity planning, resiliency testing, disaster recovery, and high-availability architectures.
- Experience working in Agile and DevOps operating models.
- Experience with scripting and automation using PowerShell, Python, Bash, or similar technologies.
- Industry certifications related to Cloud Engineering, Azure, AWS, Terraform, or Site Reliability Engineering preferred.
#LI-JB3
