Sr. Quality Automation Engineer

Accountabilities

• Develop customer-focused testing strategies: Understand real-world customer workflows, user personas, product requirements, and acceptance criteria to design meaningful automated test scenarios. Prioritize coverage according to customer impact, product risk, release frequency, and business value.

• Build and maintain automated test suites: Design, implement, troubleshoot, and maintain automated tests covering user interfaces, APIs, backend services, data pipelines, integrations, reporting, and AI-powered product functionality.

• Automate critical user journeys: Use Playwright or equivalent tools to test complex web applications and maintain smoke, regression, acceptance, integration, and end-to-end test coverage.

• Validate APIs and integrations: Use Bruno, Postman, or code-based testing to verify API contracts, authentication, payloads, error handling, integrations, and backend behavior.

• Ensure data integrity: Apply SQL queries to validate processing outcomes, workflow consistency, reporting accuracy, and customer-facing analytics.

• Strengthen automation infrastructure: Develop reusable testing utilities, fixtures, helpers, and test-data patterns. Integrate automated suites into CI/CD pipelines to deliver timely, reliable quality signals throughout development and release cycles.

• Investigate failures and reduce test instability: Diagnose flaky tests, environmental issues, timing problems, and test-data failures, distinguishing automation issues from genuine product defects. Identify coverage gaps and implement targeted improvements.

• Collaborate across teams: Partner with Product, Engineering, Data Science, Implementation, and Customer teams to understand requirements, evaluate risks, improve observability and logging, and strengthen testability and API contracts.

• Validate AI-powered experiences: Build repeatable automated checks for classifications, model outputs, prompt and configuration changes, structured responses, extraction workflows, edge cases, and downstream behavior. Use representative datasets and expected outcomes to detect regressions.

• Communicate and improve quality practices: Clearly document defects, automation gaps, and release risks while sharing reusable patterns and testing practices that improve quality engineering across the organization.

Requirements:

• At least five years of experience in test automation, software development engineering in test (SDET), or software engineering, including hands-on ownership of automated test suites.

• Production-level coding proficiency in at least one of the following languages: TypeScript, JavaScript, C#, or Python.

• Experience using Playwright or an equivalent modern UI automation framework to test complex web applications.

• Strong REST API testing experience using Bruno, Postman, or code-based approaches, including authentication, payload validation, and error handling.

• Proficiency in SQL for validating data integrity, processing outcomes, and reporting accuracy.

• Experience integrating automated tests into CI/CD pipelines, managing test data, investigating failures, and diagnosing flaky tests.

• Strong judgment in assessing product risk and selecting the appropriate testing layer, whether UI, API, integration, or data-level, without requiring every scenario to be predefined.

• Experience testing asynchronous workflows and systems involving multiple services.

• Ability to investigate complex technical issues using logs, monitoring tools, database queries, API responses, and product data.

• Strong analytical thinking, problem-solving, and technical decision-making skills, with an emphasis on building maintainable and reliable test automation.

• Effective communication and collaboration skills, including the ability to explain defects, quality risks, and testing recommendations to cross-functional stakeholders.

• A proactive, curious, and ownership-oriented mindset, with the ability to thrive in a fast-paced startup environment.

Preferred qualifications:

• Experience with C#/.NET, PostgreSQL, and Microsoft Azure.

• Experience testing large language model (LLM) or machine learning (ML) features using representative datasets, expected outcomes, and threshold-based regression checks.

• Familiarity with data ingestion pipelines, event-driven architectures, and third-party integrations.

• Experience in healthcare, contact center technology, or other regulated environments.

• Experience using AI-assisted development tools to accelerate test creation, troubleshooting, and debugging.

• Location in Indianapolis, Indiana, is preferred; qualified candidates based elsewhere in the United States may be considered for remote work.

• Must be authorized to work in the United States without requiring current or future employment visa sponsorship.

Benefits:

• Work flexibility: Remote work opportunity for candidates based in the United States, with Indianapolis, Indiana, preferred.

• Meaningful impact: Help improve healthcare outcomes by strengthening the quality and reliability of technology that transforms customer conversation data into actionable insights.

• Technical ownership: Take responsibility for automation strategy across critical product areas and influence quality engineering standards and practices.

• Cross-functional collaboration: Work closely with Product, Engineering, Data Science, Implementation, and Customer teams.

• Innovation-focused environment: Contribute to AI-powered products and evolving testing approaches in a fast-growing, venture-backed technology environment.

• Professional growth: Expand your expertise in automation engineering, AI validation, data quality, and modern software delivery practices.