Job summary

The role involves collaborating with machine learning researchers to accelerate model training and inference, focusing on large-scale models in distributed computing environments. Key tasks include investigating performance bottlenecks, profiling research code, debugging issues, optimizing resource utilization, and developing software tools to simplify distributed computing workflows.

Job details

The role involves collaborating with machine learning researchers to accelerate model training and inference, focusing on large-scale models in distributed computing environments. Key tasks include investigating performance bottlenecks, profiling research code, debugging issues, optimizing resource utilization, and developing software tools to simplify distributed computing workflows. A degree in a relevant computer science field is required, with a postgraduate degree in ML or distributed ML systems being preferred but not mandatory with exceptional experience. Candidates must have over 3 years of experience designing distributed ML training frameworks, proficiency with tools like Megatron/DeepSpeed/FSDP, and familiarity with cloud platforms, workload managers, and GPU profiling tools.

What you’ll do

The role involves collaborating with machine learning researchers to accelerate model training and inference, focusing on large-scale models in distributed computing environments. Key tasks include investigating performance bottlenecks, profiling research code, debugging issues, optimizing resource utilization, and developing software tools to simplify distributed computing workflows.

Requirements

A degree in a relevant computer science field is required, with a postgraduate degree in ML or distributed ML systems being preferred but not mandatory with exceptional experience. Candidates must have over 3 years of experience designing distributed ML training frameworks, proficiency with tools like Megatron/DeepSpeed/FSDP, and familiarity with cloud platforms, workload managers, and GPU profiling tools.

Benefits

Health Insurance
Mental Health And Wellness Management Account
Vacation Days
Retirement Savings Contribution

Listed skills

Software · Preferred
Organization · Preferred
Training · Preferred
Attention to detail · Preferred
Health · Preferred
management · Preferred
Machine learning · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

Distributed ML Training
Inference Optimization
Performance Bottleneck Investigation
Code Profiling
Resource Optimization
Software Tool Development
Distributed Computing Orchestration
ML Model Development Workflows
Cloud Platforms
Workload Managers
GPU Profiling Tools
Containerization Tools
Vector Databases
Deep Learning Research Contributions

Job areas

Science & Research
Engineering
Software
Data & Analytics
Technology