Software Engineer in Test III- Agentic AI

Who you are:

TraceLink is looking for talented full-time software engineers to build products at one of the fastest growing companies in the Pune area. If you’re self-motivated, intellectually curious, and motivated by designing and developing innovative products for global organizations, you could be a good fit for our team.

This is an excellent opportunity to learn and/or extend your knowledge in building large-scale multi-agent systems, define effective strategies for evaluating such systems, and gain hands-on experience in creating and testing non-deterministic software components.

Responsibilities :

The Software Development Engineer in Test assists in building and executing automated tests for

the Company's software products. The SDET will build testing tools to enable automated testing of

the TraceLink platform and application.

• Execute tests on the TraceLink platform and application.

• Extend and maintain automation frameworks.

• Prepare and present clear reports on defect findings that allow developers to quickly and accurately reproduce problems and allow the Quality Engineering team to verify that fixes are complete.

• Verify defect fixes.

• Build tooling for automated testing of the TraceLink platform and application.

• Programmatically interface testing tools with the TraceLink platform and application.

• Create testing tools that can be configured and used by non-developers and can simulate real-world transaction volumes involving potentially millions of transactions per day.

• Provide high-level analysis to apply appropriate technologies and architecture to solve conceptual problems

• Research and remain informed of new technology and tools, and how such technologies could be applied at TraceLink.

•  Work closely with engineers building the core TraceLink product to ensure that testability concerns are factored into the design of the product.

Qualifications :

Candidates must possess the following skills and traits:

• Bachelor's degree or foreign equivalent in computer science, software engineering, or related discipline.

• 2-5 years of progressive, post-baccalaureate experience in a test automation engineering role involving programmatic interaction with a system under test.

• 2-5 years of experience utilizing Java, JavaScript/TypeScript, Eclipse, Ant or Maven, Unix, and an automated unit test framework, such as TestNG.

• 2-5 years of experience developing against web services and Web-based APIs.

• 2-5 years of experience developing and executing formal test plans, data sets, and test configurations for assigned feature areas

• 2-5 years of experience testing web-based enterprise-class business applications.Helpful skills and experience:

Helpful skills and experience:

•  Familiarity with the concepts involved in running cloud-based applications on platforms such as Amazon Web Services.

•  Experience with the pharmaceutical industry.

•  Basic understanding of Large Language Models (LLMs) and generative AI systems.

•  Exposure to testing LLM-based applications, including prompt validation and response evaluation.

•  Familiarity with multi-agent LLM workflows and coordination patterns (e.g., agent orchestration, tool usage, chaining).

•  Experience designing test scenarios for AI systems, including edge cases, hallucination detection, and output consistency checks.

•  Knowledge of evaluation metrics for LLM outputs (e.g., accuracy, relevance, latency, and robustness).

•  Exposure to automation frameworks or tools for validating AI/ML model behavior.