This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Engineering Simulation Specialist based in India.
Join a frontier engineering-reasoning evaluation initiative focused on testing how advanced AI models solve complex engineering problems from first principles.
You will design realistic simulation-based challenges that require models to produce technically valid designs rather than rely on memorized information.
Your work will span areas such as control systems, analog and RF circuits, power electronics, and mechanical design.
You will define quantitative specifications, acceptance criteria, and simulation environments that rigorously evaluate model performance.
The role offers a unique opportunity to see how AI systems approach engineering problems and where their reasoning succeeds or fails.
You will collaborate with technical teams while working independently in a flexible, fully remote environment.
Prior experience in AI model evaluation is not required, making this an opportunity to bring your engineering expertise into an emerging field
Accountabilities:
- Design engineering evaluation problems: Create realistic, technically challenging simulation tasks that require models to design artifacts such as controller gains, circuit parameters, or mechanical geometries while satisfying multiple engineering specifications.
- Build simulation environments: Develop simulations in Python that accurately represent the engineering problem and provide a reliable basis for evaluating proposed solutions.
- Define measurable specifications: Establish clear, quantitative pass/fail thresholds and acceptance criteria that allow solutions to be assessed objectively and consistently.
- Develop effective prompts: Write task prompts that provide sufficient context and constraints while ensuring the underlying engineering problem cannot be solved through simple information retrieval or shortcutting.
- Evaluate model-generated designs: Use an agentic grading process to assess whether submitted designs satisfy all defined specifications and identify areas where the model succeeds or fails.
- Apply engineering judgment: Design problems that are sufficiently challenging to require genuine reasoning while remaining rigorous enough for you to independently validate the results.
- Contribute to frontier AI evaluation: Help generate high-quality engineering evaluation data that can be used to understand and improve the reasoning capabilities of advanced AI systems.
- Collaborate with technical teams: Participate in onboarding and ongoing support sessions, using internal tools and workflows to develop evaluation tasks efficiently and consistently.
Requirements
- Deep engineering expertise: Advanced applied experience in one or more areas such as control systems, analog or RF circuits, power electronics, or mechanical design, supported by a PhD or equivalent industry track record.
- Simulation experience: Strong ability to create engineering simulations using Python and translate technical concepts into executable, testable models.
- Quantitative reasoning: Comfortable expressing engineering requirements through precise, measurable specifications and objective pass/fail thresholds.
- Engineering judgment: Able to construct challenging problems that cannot be easily shortcut while maintaining the expertise required to assess solutions rigorously.
- Technical problem-solving: Strong first-principles reasoning skills and the ability to evaluate complex engineering designs against multiple constraints.
- Attention to detail: Highly rigorous approach to specifications, simulation accuracy, testing methodology, and evaluation criteria.
- Digital collaboration skills: Comfortable working in browser-based development environments and using GitHub for technical workflows.
- Adaptability: Willingness to learn new evaluation methodologies and contribute to emerging AI-focused engineering projects; prior model-evaluation experience is not required.
- Work arrangement: Available to work as an independent contractor in a fully remote role based in India.
- Eligibility: H-1B and STEM OPT candidates cannot be supported for this opportunity.
Benefits
- Competitive compensation: Payment is provided based on services rendered, with competitive project-based compensation.
- Flexible remote work: Complete the work fully remotely and manage your schedule with a high degree of flexibility.
- Weekly payments: Receive payments weekly through Stripe or Wise.
- Flexible project duration: Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Frontier AI exposure: Contribute to advanced AI evaluation initiatives and gain direct exposure to how state-of-the-art models approach complex engineering problems.
- Technical impact: Apply your engineering expertise to projects designed to improve the reasoning and capabilities of next-generation AI systems.
- Structured support: Access daily onboarding calls and internal tools designed to help you work efficiently.
- No proprietary-information requirement: Your work does not require access to confidential or proprietary information from any employer, client, or institution.
- Referral opportunity: Eligible referrals may provide an opportunity to earn rewards, subject to applicable terms and restrictions.
How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1
