Want to know if this job is worth applying to?
Georgia, United States
Remote only
Ensora Health is the leading provider of software and services for mental and behavioral health therapists, trusted by over 200,000 individual providers and more than 28,000 practices. Our unmatched expertise, partnership, and breadth of products allow us to fine-tune solutions that meet the specific needs of everyone from solo practitioners to larger practices. With AI-enabled solutions that span practice management to electronic medical records and e-prescribing to billing, we help eliminate administrative complexity and create harmony between therapists, their clients, and the whole healthcare community.
Job Description
We are seeking a AI Software Development Engineer in Test (SDET) to ensure the quality, reliability, and trustworthiness of AI‑powered applications. This role is automation‑first and focuses heavily on validating AI behavior, verifying data correctness, and ensuring system reliability across backend services, data pipelines, Retrieval‑Augmented Generation (RAG) systems, and AI agents. You will work closely with AI, machine learning, data, and platform engineering teams, with guidance and support from senior quality leadership.
What You’ll Do
Design, build, and maintain robust automated tests for backend services, APIs, and AI‑enabled systems
Validate end‑to‑end AI workflows, including data inputs, retrieval logic, and generated outputs
Test RAG systems by verifying source data quality, retrieval accuracy, and response correctness
Perform data verification to ensure the accuracy of summarized, derived, and feature‑level data used by AI systems
Validate AI behavior for consistency, edge cases, regressions, and failure scenarios
Identify data anomalies, drift, and pipeline issues impacting AI outputs and collaborate on resolution
Integrate automated tests into CI/CD pipelines and contribute to quality metrics and reporting
Support performance, reliability, and scalability testing for AI‑driven services
What You Bring
Strong experience as an SDET or Automation Engineer with a focus on backend and service‑level testing
Proficiency in test automation using one or more programming languages (TypeScript, Java, C#, or Python)
Strong experience with API testing and distributed systems validation
Solid understanding of data validation concepts including accuracy, consistency, and completeness
Strong SQL skills
Hands‑on experience using SQL and/or programmatic checks to validate data used by applications or AI systems
Experience integrating automated tests into CI/CD pipelines
Ability to translate requirements and expected AI behavior into reliable, repeatable automated tests
Nice to Have
Experience testing AI/ML systems, RAG pipelines, or LLM‑based applications
Familiarity with testing non‑deterministic systems and defining effective test oracles
Experience validating data drift, model regressions, or AI behavior changes over time
Familiarity with Playwright, Postman, or similar testing frameworks
Experience working with data‑intensive platforms or analytics systems
Background in healthcare or other regulated environments
Interest in leveraging AI‑assisted testing techniques to improve coverage and efficiency
While we've outlined some key qualities we typically seek, it's essential to remember that there might be additional unique strengths and talents you possess that would make you an exceptional match for us, even if they're not explicitly mentioned. Studies have consistently highlighted the significance of this principle, particularly for individuals from disenfranchised backgrounds, including women and other marginalized groups. These individuals often hesitate to apply unless they meet every single requirement, unlike their male counterparts who are more inclined to apply when they meet around 60% of the criteria.
The message we want to convey is that taking a leap of faith and applying can be incredibly rewarding. Your distinct abilities and perspectives could be exactly what we need to create a more diverse and inclusive team. So, don't hesitate—apply today and let's explore the exciting possibilities together!
All your information will be kept confidential according to EEO guidelines.
At Ensora Health, Diversity, Equity, Inclusion, and Belonging aren’t just words. We celebrate what makes us unique, foster an ecosystem of inclusion for all and harness our talents to promote diversity of thought and action in everything we do.
We instill Diversity, Equity, Inclusion, and Belonging into the fabric of our CARING culture and business, as we strive to be recognized not only as the leader in healthcare technology, but also for our intentional efforts to promote a diverse community.
We will champion non-discriminatory practices throughout the employee and customer lifecycle; caring for every person regardless of race, national origin, color, religion, disability, sex, orientation, or familial status.
Ensora Health is an equal opportunity employer.