ML Infrastructure Engineer

About the Role

Mistral AI is hiring an ML Infrastructure Engineer to build and scale training and inference infrastructure for our open-weight language models. You will design systems that enable efficient training of frontier models on large GPU clusters.

Requirements

• 5+ years of infrastructure or systems engineering experience
• Strong experience with Kubernetes and container orchestration
• Proficiency in Python and at least one systems language (Rust, C++, Go)
• Experience managing large GPU clusters (NVIDIA A100/H100)
• Deep understanding of networking and storage for ML workloads

Nice to Have

• Experience with model serving frameworks (vLLM, TensorRT-LLM)
• Background in HPC or scientific computing
• Familiarity with European cloud providers
• Experience with model parallelism strategies

Benefits

Skills

Related Jobs