New York, NY · Salary not listed
Posted May 13, 2026 · Experience not stated
Opens Material Holdings LLC's own application page in a new tab, this page stays open behind it.
Senior Director, Benefits
Named on Material Holdings LLC's FY2026 H-1B filings
Sign in to see their name and work email, plus a short intro note you can edit and send. You reach a person instead of dropping your resume into another online form. Not always the recruiter for this opening.
Create a free accountFiling data last recomputed Aug 23, 2026.
Sponsor score is an evidence index from 0 to 100, built from this employer's past public DOL and USCIS filings. It is not a probability that this role will sponsor you. Read how scores work.
About the role
Serving frontier models at scale requires solving novel systems problems at every layer of the stack. As an Inference Performance Engineer, you'll own the runtime that turns accelerators into a production serving system, optimizing throughput, latency, and cost across thousands of nodes. You'll work alongside hardware and compiler teams operating at the frontier of AI silicon design.
What you'll do
Build and improve the inference runtime
Design scheduling, continuous batching, KV cache, and prefill/decode disaggregation
Implement low-precision kernels and speculative decoding
Drive throughput, latency, and cost per token
Collaborate with hardware teams on kernels, operators, and graph optimizations
Own the OpenAI-compatible API surface and serving protocol
Build benchmarking, profiling, and regression infrastructure
What you'll need
BS in CS, EE, or related field, or equivalent experience
Software engineering experience: Rust, Go, Python, or C++
Understanding of concurrency, memory, and tail latency
Understanding of modern inference: transformers, attention, KV cache, batching, speculative decoding, quantization
Experience with model serving frameworks: vLLM, TGI, SGLang, TensorRT-LLM, llama.cpp, or custom runtimes
GPU or ASIC programming experience: CUDA, ROCm, Triton, or vendor-native toolchains
Experience with low-precision inference (FP8, FP4, INT4)
Profiling and benchmarking experience: Nsight, perf, custom harnesses
What we offer
Top-tier compensation structured to recognize and retain the best talent
Meaningful equity
Comprehensive medical, dental, vision, life, and disability insurance
Parental leave for all new parents, including adoptive and surrogate journeys
Flexible PTO
Paid Holidays
Relocation support
Equal Employment Opportunity
We're an Equal Opportunity Employer and do not discriminate on the basis of any protected status under applicable law.