Luminal
Making AI run fast on any hardware.
Cloud Inference Engineer
About the role
Qualifications
- CUDA + GPU inference optimization
- vLLM, SGLang, or TensorRT-LLM experience
- KV caching, paged attention, batching, token streaming, etc.
- Distributed compute (with GPUs is a super plus)
- No degree required
Company
Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line.
Role
Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud.
Day to day responsibilities:
- Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
- Conducting model performance reviews
- Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
- Sometimes write kernels and, yes, occasional tasteful shitposting
About Luminal
Luminal (YC S25) is focused on optimizing AI models to accelerate and simplify model deployment. We are building an AI compiler that enhances model speeds by 10x and streamlines deployment to production with just a single line of code. Our mission is to turn AI research code into production code, seamlessly.
Role Description
This is a full-time on-site role for a Founding Engineer located in downtown San Francisco. The Founding Engineer will be responsible for assisting the design of the core compiler. Day-to-day tasks will include writing CUDA kernels, conducting model performance reviews, and shitposting on social media.
