Founded in 1999 in Vienna, the Qualysoft Group is a manufacturer-independent IT consulting and services company, which successfully provides support for its international customers with the aim of boosting their competitiveness and economic efficiency through innovative IT solutions.
Its focus is on financial services providers, telecommunications companies, the automotive industry and energy service providers. Over 400 employees in 6 subsidiaries work together to ensure state of the art solutions for our clients.
We are looking for new colleagues in Qualysoft teams for diverse projects providing continuous learning opportunities. Our common goal is to provide honesty, development and a stable background while getting to know the latest technologies. We are waiting for your application for the position below!
Project Overview
The project focuses on the implementation of the DX platform (getdx.com) as a Proof of Concept (PoC), with a strong focus on objectively measuring the value generated by AI-assisted software development tools.
AI-powered development tools such as GitHub Copilot, coding agents, and AI-assisted code review solutions are increasingly being adopted. However, their actual business value is currently difficult to measure reliably.
The objective of the PoC is to assess whether AI adoption, usage intensity, development time savings, and the impact on quality and lead times can be reliably measured, integrated into existing systems, and used to support well-founded ROI, investment, and scaling decisions.
Key Responsibilities
- Support the selection of pilot teams and the definition of an AI value measurement model.
- Define measurement and success criteria covering AI adoption, usage intensity, time savings, lead time, quality impact, and ROI.
- Set up and configure the DX platform, including SSO/identity integration and the permission model.
- Integrate DX with existing GitLab, CI/CD, ticketing, and identity/SSO systems.
- Integrate usage and telemetry data from the AI tools in use, including GitHub Copilot usage data / Copilot Metrics API.
- Configure teams, hierarchies, and data models within the DX platform.
- Set up and validate identity and team mapping across AI tools and delivery systems.
- Link AI-related metrics with relevant cost data.
- Set up the DX AI Measurement Framework surveys and system-side data collection.
- Establish baseline measurements before and after the expansion of AI usage.
- Analyze the impact of AI on quality-related metrics such as change failure rate, review effort, rework, and security findings, ensuring that AI value is not assessed solely in terms of speed.
- Ensure data quality, consistency, and completeness, including error analysis and correction.
- Implement technical requirements related to anonymization, aggregation, and data minimization.
- Ensure a clear separation between AI usage measurement and individual performance measurement.
- Develop dashboards, reports, and exports to support results analysis and ROI assessment.
- Identify the most effective AI use cases and key barriers to adoption based on the evaluation results.
- Support the definition of enablement measures and the future scaling and license strategy.
- Prepare technical documentation and estimate the effort and resources required for future scaling.
Why we think you will love working here:
With us you count as a person, our doors are always open.
We live the Qualysoft Team Spirit and stand for transparency!
Fresh wind and new ideas are welcome, because standstill is a foreign word at Qualysoft.
