Senior ML Engineer (Token Factory)

Accountabilities

• Develop and improve advanced fine-tuning methodologies, including LoRA-based and full-parameter approaches, for cutting-edge foundation models.
• Optimize model quality and training efficiency across large-scale machine learning workloads.
• Identify and address bottlenecks in large language model inference to improve production performance and resource efficiency.
• Build training and evaluation pipelines using JAX for techniques such as speculative decoding and advanced inference optimization.
• Experiment with different model architectures, including dense and mixture-of-experts models as well as autoregressive and parallel approaches.
• Develop and evaluate scaling laws to inform model development, performance optimization, and resource allocation.
• Investigate low-precision training and inference approaches, including FP8, NVFP4, and MXFP4, for supervised fine-tuning and reinforcement learning.
• Work with distributed training environments spanning multiple computational nodes and large GPU clusters.
• Analyze performance considerations such as sharding strategies, custom kernels, and modern hardware capabilities.
• Translate research concepts and experimental results into robust, scalable, production-quality machine learning systems.
• Apply strong software engineering practices, including CI/CD, version control, unit testing, and maintainable code design.
• Collaborate across engineering and research teams while communicating technical concepts clearly and contributing to technical direction.

Requirements

• Deep understanding of the theoretical foundations of machine learning and reinforcement learning.
• Strong expertise in modern deep learning techniques for language processing and generation.
• Demonstrated experience training large machine learning models across multiple computational nodes.
• Solid understanding of performance optimization for large neural network training, including sharding strategies, custom kernels, and hardware-specific capabilities.
• Strong software engineering skills, particularly with Python.
• Extensive experience with modern deep learning frameworks, particularly JAX.
• Proficiency in contemporary software development practices, including CI/CD, version control, unit testing, and production-quality engineering.
• Strong communication, collaboration, and technical leadership abilities.
• Experience working with language models or related NLP technologies is highly valued.
• Familiarity with concepts such as multi-head attention, RoPE, ZeRO/FSDP, Flash Attention, and quantization is advantageous.
• Experience building and delivering products in dynamic, startup-like environments is a plus.
• Strong engineering background in distributed systems or high-load web services is beneficial.
• Open-source projects demonstrating advanced engineering capabilities are valued.
• Excellent English communication skills, including strong technical writing and articulation.

Benefits

• Competitive compensation.
• Career growth and continuous learning opportunities.
• Flexible working environment with a high degree of ownership.
• Opportunity to work on impactful, large-scale AI and machine learning projects.
• Collaborative culture with experienced engineers and researchers.
• International environment with diverse and highly skilled teams.
• Opportunity to contribute to advanced foundation model training, fine-tuning, inference optimization, and AI infrastructure.
• Exposure to cutting-edge GPU computing, distributed systems, and modern machine learning technologies.
• Inclusive workplace committed to equal employment opportunities.
• Support and reasonable accommodations throughout the hiring process when required.