MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling)
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.
- Pay
- Firm hourly pay: $90-$120 per hour
- Location
- Canada, UK, US
- Eligibility
- Remote; check the Canada location wording
- Qualification difficulty
- Selective
How current is this information?
The public role and application path were checked. Details can still change; this is not an endorsement or guarantee.
- Platform
- Mercor
- Fit category
- Software engineering
- Listing/source checked
- Sep 16, 2026
- Inventory presence checked
- Sep 28, 2026
- Apply link checked
- Sep 16, 2026
Application
Continue to the current Mercor listing
Apply on MercorOpens the current Mercor page in a new tab. This may be a referral link, and Specialist AI Work may be paid if the platform credits it. That does not change the role's advertised pay or how roles are ordered here.
What this role involves
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. 1. Overview Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up.
We're seeking MLOps Engineers with hands-on experience in large language model infrastructure across any of four areas: GPU kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. This role involves AI model training and evaluation work, including writing and assessing MLOps and ML systems tasks and solutions to generate high-quality training data for frontier AI systems.
This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce. This is a 40-hour full-time engagement, with no conflicts/no other engagements. 2.
Key Responsibilities
Design challenging, domain-relevant tasks across four areas, GPU kernels, performance profiling, debugging, and inference serving, and write accurate, well-structured solutions to them. Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, training infrastructure, and framework-level topics. Evaluate MLOps and ML systems tasks and solutions, and provide clear, written technical feedback that stands up to reviewer scrutiny.
Develop guidelines and detailed rubrics or evaluation frameworks covering kernel-level optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs. Collaborate with other subject matter experts to keep training data consistent and accurate. 3. Core Qualifications 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU and accelerator performance engineering.
This is a hands-on systems role rather than an applied modelling or data science one. Practical experience in at least one of the following, with more than one a strong plus: writing or optimizing custom GPU kernels (CUDA, Triton, Pallas); performance profiling and trace analysis (Kineto, torch.profiler, Nsight, XLA or JAX profiler); debugging distributed or accelerator-bound workloads; serving large language models at scale (vLLM, SGLang, TensorRT-LLM, Ray Serve, KV cache, paged attention, continuous batching).
Working production experience with JAX and/or PyTorch. Framework-level depth is a strong plus: custom operators, distributed training (FSDP, DDP, DeepSpeed, Megatron), or compiler and graph-level work. Familiarity with modern accelerators such as A100, H100, B200 or TPU, and the ability to reason about throughput, latency and memory trade-offs. Demonstrable career progression. Ability to engage reliably for at least 40 hours/week during weekdays.
Before you apply
Review the main fit signals and unresolved details before opening the platform.
Why it may fit
- Professionals whose experience matches the current MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling) requirements.
- Applicants comfortable completing Mercor's role-specific assessment.
Check before applying
Reasons to pause
- You cannot meet the listing's stated remote or location eligibility.
- You need guaranteed acceptance, hours, or project duration.
Still to verify
- Review the official Mercor listing before applying. Requirements, screening, pay, hours, and project availability can change.
- The reviewed listing had limited public detail; check the current platform page for the full requirements.
What to prepare
- Complete Mercor's role-specific application or assessment.
Role tools
Where these choices are saved
Save, Not for me, Compare, and application tracking remain in this browser.
Application tips
- Complete Mercor's role-specific application or assessment carefully.
- Review the current Mercor listing and its eligibility details before applying.