Gaithersburg, Maryland, United States
WHY JOIN US?
Evinova is a health-tech business focused on accelerating better health outcomes by advancing digital transformation across the life sciences sector. By combining science-based expertise, evidence-led rigor, and deep human insight, we design digital solutions that enable healthcare to work better for everyone. Operating at the intersection of healthcare, technology, data, and analytics, we are helping unlock the full potential of digital health, transforming how clinical research is conducted, how care is delivered, and how patients experience healthcare. Our solutions are built to scale, driving efficiency, improving decision-making, and ultimately delivering better outcomes for patients worldwide.
At Evinova, we are driven by a shared purpose to transform health through data and digital innovation. Our teams collaborate across disciplines to solve complex challenges, continuously learning and evolving in a fast-paced, high-impact environment.
We also recognize the importance of flexibility and balance. Our ways of working support both individual needs and team collaboration. To foster connection and collaboration, employees are expected to work from the office three days per week, creating opportunities for in-person teamwork, innovation, and meaningful connection.
About the Role
Evinova is building AI-native products that are reshaping how clinical trials are designed, documented, and delivered. Our AI-native product suite include Study Designer, Study Document Assistant, AI Document Authoring, and Pipeline Management and put large language models, intelligent automation, and human-centered design directly into the hands of clinical researchers and life-sciences professionals.
We’re looking for a Test Engineering Leader who is equal parts strategist and practitioner—someone who can define how we validate AI-powered software at scale, then roll up their sleeves and prove it works. You’ll own quality across multiple products, shape the testing culture for cross-functional squads, and pioneer approaches to challenges that simply didn’t exist a few years ago: evaluating LLM outputs, validating RAG pipelines, and ensuring AI-generated content meets regulatory expectations in a GxP environment.
If you’ve been waiting for a role where deep test engineering craft meets the frontier of AI—and where your work genuinely improves patient outcomes—this is it.
What You'll Do:
Design and own end-to-end test strategies—automated and manual—for products that integrate LLMs, generative AI, and complex data pipelines.
Develop novel evaluation frameworks for LLM output quality, prompt regression testing, and RAG retrieval accuracy.
Select, implement, and continuously improve testing tools and frameworks in collaboration with engineering leadership and platform excellence teams.
Drive a measurable shift from manual to automated testing, with clear metrics to track progress.
Be the single point of accountability for testing across all releases of your two products.
Build and maintain automation frameworks and scripts that keep pace with rapid release cycles.
Analyse test results, spot trends, and turn data into actionable improvements—not just reports.
Prepare release-readiness documentation and quality artifacts that satisfy both internal stakeholders and GxP compliance requirements.
Partner with engineering managers, scrum masters, and delivery leads across squads and geographies to establish a shared quality vision.
Lead external contract test engineering squads by influence—setting standards, mentoring team members, and modelling engineering excellence.
Champion a quality-engineering mindset: everyone ships quality, not just the test team.
Stay hands-on—write test cases, debug failures, and pair with engineers when the situation calls for it.
What You Bring:
Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, Information Science, or a related field (or equivalent practical experience).
10+ years of hands-on software test engineering experience across the full stack (UI, API, data).
Proven ability to lead test strategy and mentor other test engineers—whether through formal management or technical leadership.
Strong automation skills with modern frameworks such as Playwright, Selenium, or Cypress, plus scripting fluency in Python or a comparable language.
Solid experience with REST API testing, database validation (PostgreSQL, MongoDB, or similar), and CI/CD-integrated test pipelines.
A data-driven approach to quality: you define metrics, instrument dashboards, and use evidence to drive decisions.
Highly Preferred
Experience testing AI/ML-powered products—especially LLM evaluation, prompt testing, RAG validation, or output-quality benchmarking.
Familiarity with GxP software validation, computerised system validation (CSV), or regulated-industry quality practices.
Background in life sciences, health-tech, or clinical-trial technology.
Experience working with geographically distributed teams and external vendor squads.
SO, WHAT’S NEXT?
To be considered for this exciting opportunity, please complete the full application on our website at your earliest convenience – it is the only way that our Recruiter and Hiring Manager can know that you feel well qualified for this opportunity. If you know someone who would be a great fit, please share this posting with them.
Where can I find out more?
Apply today to bring smarter, faster clinical trials to life!
Evinova is an equal opportunity employer that is committed to diversity and inclusion and providing a workplace that is free from discrimination. Evinova is committed to accommodating persons with disabilities. Such accommodation is available on request in respect of all aspects of the recruitment, assessment and selection process and may be requested by emailing AZCHumanResources@astrazeneca.com.
#LI-Hybrid
The annual base pay for this position ranges from $165,656.80 - $217,424.55 USD. Base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience.
In addition, our positions offer a short-term incentive bonus opportunity; eligibility to participate in our equity-based long-term incentive program. Benefits offered included a qualified retirement program [401(k) plan]; paid vacation and holidays; paid leaves; and, health benefits including medical, prescription drug, dental, and vision coverage in accordance with the terms and conditions of the applicable plans.
Additional details of participation in these benefit plans will be provided if an employee receives an offer of employment. If hired, employee will be in an “at-will position” and the Company reserves the right to modify base pay (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.
Date Posted
15-Jul-2026Closing Date
30-Jul-2026Our mission is to build an inclusive environment where equal employment opportunities are available to all applicants and employees. In furtherance of that mission, we welcome and consider applications from all qualified candidates, regardless of their protected characteristics. If you have a disability or special need that requires accommodation, please complete the corresponding section in the application form.
Want to know if this job is worth applying to?
Onsite