Senior Deep Learning Researcher, LLM Inference
At a glance
Senior AI Research role at NVIDIA. Israel, Tel Aviv · full-time.
Pay not stated AI Research salary
aimlroles summary, based on the employer's posting.
What you'll do
- Develop new LLM inference methods for both fast responses and high-throughput workloads
- Turn research findings into software that affects NVIDIA products and customer use
- Work with research, engineering and product groups worldwide to advance inference technology
- Test algorithms on NVIDIA hardware, finding performance bottlenecks and optimization opportunities
- Bring ideas from scientific and industry partners into practical inference applications
What you bring
- A master's or doctoral degree in computer science, electrical engineering or a closely related discipline
- At least five years of deep learning or applied research experience
- Research papers accepted at leading AI or machine learning conferences
- Strong knowledge of LLM designs, experience training large models, and programming ability in Python and PyTorch
Who this fits
This senior research role suits someone focused on LLM inference algorithms who can turn research into software and evaluate it on NVIDIA hardware. You’ll collaborate with teams across the globe and work with external scientific and industry partners.
From the employer
We are seeking a highly motivated Senior Deep Learning Researcher to join our team! This is an outstanding opportunity to conduct impactful research and develop the next generation of large language model (LLM) inference algorithms. You will work on technologies that directly enhance NVIDIA's software, making the latest LLMs more efficient and accessible for users worldwide.
By joining us, you will be part of a strategic effort to establish NVIDIA as the definitive platform for high-performance LLM inference. You will engage with skilled problem-solvers at NVIDIA and top organizations, crafting AI technology advancements.
What you'll be doing:
Research, invent, and implement groundbreaking algorithms for LLM inference to advance the state of the art in both low-latency and high-throughput scenarios.
Translate research into practical software solutions that directly impact NVIDIA's products and customers.
Collaborate with internal research, engineering, and product teams across the globe to drive the development of advanced inference technologies.
Analyze the performance of new algorithms on NVIDIA’s latest hardware, identifying bottlenecks and opportunities for algorithmic optimizations.
Partner with leading scientific organizations and industry pioneers to remain at the forefront of technological advancements and integrate the latest innovations into practical applications.
What we need to see:
MSc/PhD in Computer Science, Electrical Engineering, or a closely related field.
At least 5 years of relevant experience in deep learning research or applied research.
Publications in a top-tier AI/ML conference (e.g., NeurIPS, ICLR, ICML).
Deep understanding of LLM architectures coupled with hands-on experience in training large-scale models.
Excellent programming skills, particularly in Python and deep learning frameworks like PyTorch, and experience with software engineering standards.
A strong problem-solving mentality and a proactive attitude, driven by the ambition to deliver solutions with real-world impact.
Ways to stand out from the crowd:
Hands-on research experience in LLM inference optimization algorithms such as speculative decoding or parallelization strategies.
Proven experience with High-Performance Computing (HPC) environments, including training or running inference on large-scale GPU clusters (tens to hundreds of GPUs).
Deep familiarity and experience with popular LLM inference systems (e.g., vLLM, TensorRT-LLM).
Experience from a world-class industrial research group or a top-tier institution.
We are an equal-opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.