Want to know if this job is worth applying to?
München, Bayern, Deutschland
Hybrid
About Us
Manex AI is on a mission to enable autonomy for the world's leading organizations, currently building the production system for the era of autonomous manufacturing. With our Seed Round raised from Lightspeed and BlueYard and leading manufacturing enterprises relying on our systems, we are now scaling fast. For our world-class team, we are looking for exceptionally driven students who want real ownership early.
Your Role
Testing conventional software is a solved problem. Testing AI systems is not. Classic assertions stop working when a system can answer correctly in five different ways, and the industry is still writing the playbook for what comes next.
You define what good looks like for AI features that run in customer production environments. Kosmos, our platform, is live at industry leaders such as BMW, Audi, BSH, Stellantis, and TDK Electronics. The job comes with two main responsibilities. The first is evals: building the datasets and scoring methods that turn a vague impression of quality into a number the team can act on. The second is classic engineering rigor: automated end-to-end tests, regression suites, CI that catches issues while a feature is still a branch, and experiments that show where performance and scalability stand.
The mindset we hire for is adversarial. Your job is to find the edge cases nobody thought of and the prompt nobody expected, and then to prove exactly what happened and why.
For working students who deliver, this is the fastest path into a full-time engineering role.
Your Responsibilities
Design and run evals for our AI features, including datasets, scoring and regression tracking over time
Investigate performance and scalability bottlenecks, then design experiments to show the impact of the fix
Extend our CI pipeline so quality signals reach engineers early
Do exploratory and edge case testing on new features before they reach customer environments
Document and present findings precisely such that an engineer can act on them
Your Profile
Currently studying Computer Science, Information Systems, or similar
Available 16 to 20 hours per week during the semester, with the option to work more during semester breaks
Strong hands-on coding ability in Python, TypeScript or similar, proven via own projects, ventures, or open-source work
Curiosity about how LLM-based systems behave and how to measure them, whether from coursework, side projects, or reading
Enjoying breaking systems, and even more finding the root cause
An ownership mindset: taking initiative, moving fast, and finishing what you start
Fluent in English and ideally in German as well
Based in Munich, hybrid, with regular time on-site with the team
Ideally experience with Playwright, Cypress or Selenium, API testing, Docker, and CI/CD
We appreciate your application even if you don't tick all the boxes.
What We Offer
Real ownership from day one, including how quality and evals work here
Direct mentorship from senior engineers and direct access to founders
Hands-on experience with real customers, real production systems, and frontier AI
Hours that flex around lectures and exam periods
A fast-paced environment backed by the world's best investors, with the world's leading organizations as customers
Curious? Apply now.