about the company.
our client is a leading AI for science company , focusing on life science field.
about the team.
team members are from different professional and cultural background, there will be cross regional collaboration.
...
about the job.
- Design, provision, and operate large-scale distributed training environments across multi-GPU, multi-node clusters using Kubernetes and managed ML platforms (AWS SageMaker HyperPod/EKS, Tencent TiOne, etc.).
- Configure and tune model/data parallelism strategies (data, tensor, pipeline, sequence, MoE) to maximize throughput.
- Improve training efficiency, manage storage pipelines (S3, EFS, FSx for Lustre), and engineer robust checkpointing/fault tolerance.
- Build observability tools, CI/CD pipelines, and infrastructure-as-code for training.
- Design and run post-training workflows (SFT, RFT/RLVR/RLAIF, continual pretraining) and integrate expert models into production drug-discovery workflows.
skills and experience required.
- Education: Bachelor in Computer Science and above.
- Experience Level: 5+ years of hands-on experience spanning ML infrastructure / LLMOps and LLM training.
- Technical Skills:
- Deep, hands-on expertise with Kubernetes for large-model training across multiple platforms (AWS, GCP, Azure, or Tencent TiOne).
- Strong understanding of distributed-training parallelism strategies.
- Hands-on experience with frameworks like PyTorch (DDP/FSDP), DeepSpeed/ZeRO, and the Hugging Face ecosystem.
- Fluency with cloud storage and high-throughput data systems (S3, EFS, FSx for Lustre).
- Practical understanding of post-training and RL methods (SFT, GRPO, PPO, DPO, reward modeling).
- Strong Python, container/orchestration (Docker/Kubernetes), and infrastructure-as-code skills.
- Desirable Extras (Nice-to-Have):
- Experience with Megatron-LM, NVIDIA NeMo, TRL, verl, or vLLM.
- Knowledge of cluster networking (NCCL tuning, EFA/RDMA/InfiniBand) and schedulers (Slurm, Ray, Volcano).
- Familiarity with AI-for-Science applications (biomedical, chemical) and experiment tracking tools (W&B, MLflow).