Saviynt's AI-powered identity platform manages and governs human and non-human access to all of an organization's applications, data, and business processes. Customers trust Saviynt to safeguard their digital assets, drive operational efficiency, and reduce compliance costs. Built for the AI age, Saviynt is today helping organizations safely accelerate their deployment and usage of AI. Saviynt is recognized as the leader in identity security, with solutions that protect and empower the world’s leading brands, Fortune 500 companies and government institutions. For more information, please visit www.saviynt.com.
AI agents are only as good as the intelligence behind them. At Saviynt, our customer support runs on autonomous AI agents that triage, route, and resolve cases without human intervention and we’re just getting started. The next frontier is measurable: higher deflection, faster closure, and agents that learn from every interaction. This role sits at the center of that mission. As our Business Analyst Customer Support (AI), you are the analytical engine that tells us exactly where our agents are winning, where they’re failing, and what it will take to push autonomous resolution rates higher. You track agent performance at a granular level, identify patterns in cases that escape to humans, and feed those findings directly into the tuning cycles that make our AI sharper over time. If you’ve spent time obsessing over how AI models behave in production, why they escalate when they shouldn’t, what makes a deflection stick, how to measure agent generated productivity gains and you want a role where that obsession moves real metrics, this is it.
While our AI agents are already operational and managing significant volume, we are focused on bridging the critical gap between current performance and full autonomous resolution. We need a specialist who goes beyond surface-level reporting to rigorously interrogate deflection and closure metrics. As case patterns evolve, you will be responsible for benchmarking agent confidence scores and identifying the precise improvements needed to optimize our autonomous capabilities. This is a high-ownership, high-visibility role. The insights you surface will directly shape how our agents are trained, how AI-assisted productivity gains are measured, and how we define what “good” looks like in an AI-first support operation
WHAT YOU WILL BE DOING
● Own the performance analytics for our AI agent fleet — tracking deflection rates, autonomous closure rates, escalation triggers, confidence score distributions, and CSAT by resolution type to give us a precise, real-time picture of where agents are succeeding and where they’re not.
● Dig into cases that escape AI resolution — identifying the intent clusters, knowledge gaps, and routing failures that cause unnecessary escalations, and translating those findings into specific improvements for agent training and prompt refinement.
● Define and govern the KPI framework for AI productivity — including human-time-saved per resolved case, agent-assisted vs. fully autonomous closure ratios, and the quality metrics that validate whether AI resolution is genuinely satisfying customers or just closing tickets.
● Build and maintain real-time dashboards that surface AI agent health, case closure velocity, and deflection trends — giving the support leadership a live signal on how the AI operation is performing at any given moment.
● Run structured QA and eval cycles on AI agent outputs — reviewing response accuracy, tone calibration, and resolution completeness to catch quality drift before it shows up in CSAT or re-open rates.
● Prepare concise, evidence-based briefings for leadership on AI agent performance and productivity gains — translating what the data shows into clear narratives about where to invest next to push resolution rates higher
WHAT YOU BRING
● 3–6 years of experience in analytics or business intelligence, with at least some of that time spent analyzing AI, ML, or LLM powered systems in a production environment you’ve measured how models behave in the real world, not just in test sets.
● Hands on experience with AI agent evaluation you know how to design rubrics, run QA cycles, and define what “good resolution” actually means in a support context. You can calibrate quality, not just count tickets.
● Sharp analytical instincts you can tell the difference between a deflection rate that’s improving because agents are getting better and one that’s improving because frustrated users are giving up. You ask the next question, not just the first one.
● Clear communication you can turn a complex AI performance analysis into a crisp recommendation that a support leader can act on immediately, without needing a technical deep-dive to understand the point.
●Familiarity with prompt engineering or context engineering enough to have informed opinion on why an agent responded the way it did and what a better prompt structure would look like
If required for this role, you will:
- Complete security & privacy literacy and awareness training during onboarding and annually thereafter
- Review (initially and annually thereafter), understand, and adhere to Information Security/Privacy Policies and Procedures such as (but not limited to):
> Data Classification, Retention & Handling Policy
> Incident Response Policy/Procedures
> Business Continuity/Disaster Recovery Policy/Procedures
> Mobile Device Policy
> Account Management Policy
> Access Control Policy
> Personnel Security Policy
> Privacy Policy
Saviynt is an amazing place to work. We are a high-growth, Platform as a Service company focused on Identity Authority to power and protect the world at work. You will experience tremendous growth and learning opportunities through challenging yet rewarding work which directly impacts our customers, all within a welcoming and positive work environment. If you're resilient and enjoy working in a dynamic environment you belong with us!
Saviynt is an equal opportunity employer and we welcome everyone to our team. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.
