Perception Engineer - Multimodal & Embodied AI (R6022)
At a glance
Mid-level AI Research role at Shield AI. San Diego · full-time · $165,000–$300,000 base.
aimlroles summary, based on the employer's posting.
What you'll do
- Assess emerging models against real sensor samples and the needs of autonomous systems
- Prototype candidate methods to expose their strengths, weaknesses, and potential for practical use
- Combine learned and established techniques to improve detection, tracking, geometric vision, or sensor fusion
- Write Python and C++ software, then tune and integrate capabilities for edge use
- Ship tested, documented features and stay engaged as other teams adopt them
What you bring
- A PhD in computer vision, machine learning, robotics, or a related field, or equivalent research and engineering work
- Deep research experience in multimodal vision, visual foundation models, video understanding, or another listed area
- Strong Python skills and experience using PyTorch or a comparable machine-learning framework
- Substantial research software experience, with care in experiment design, evaluation data, and diagnosing model failures
Who this fits
This role suits researchers keen to put perception advances onto real hardware, working with research and autonomy engineers. It is full-time and on-site in San Diego. Recent PhD graduates and early-career researchers are welcome; product engineers can support your development of production-quality C++.
From the employer
Job Description:
Bring promising AI research into autonomous systems that operate in the real world. Shield AI’s Perception team is looking for an engineer who enjoys exploring new ideas and making them work on real hardware. You’ll help turn advances in multimodal computer vision, visual foundation models, and embodied AI into useful capabilities for autonomous aircraft and vehicles.
Working alongside researchers and autonomy engineers, you’ll evaluate promising approaches, build prototypes, and carry successful ideas into the Hivemind product. You’ll combine learned methods with established perception techniques, working through the sensor, software, and compute challenges that make edge robotics different from a benchmark.
What you'll do:
-
Evaluate emerging models and methods against representative sensor data and autonomy needs.
-
Build prototypes and experiments that reveal strengths, limitations, and practical deployment opportunities.
-
Combine learned and classical approaches to improve detection, tracking, geometric vision, or sensor fusion.
-
Optimize and integrate capabilities for edge deployment, contributing Python and C++ software with support from experienced product engineers.
-
Help deliver tested, documented capabilities and stay involved as other teams adopt them.
Required qualifications:
-
A PhD in computer vision, machine learning (ML/DL), robotics, or a related field, or an equivalent record of advanced research and hands-on engineering.
-
Research depth in an area such as multimodal vision, visual foundation models, video understanding, open-vocabulary perception, or embodied learning.
-
Strong Python skills and experience with PyTorch or a comparable ML framework.
-
A thoughtful approach to experiments, evaluation data, and understanding why models fail.
-
Experience building substantial research software, an interest in developing production-quality C++, and a collaborative approach to solving problems.
Preferred qualifications:
-
Experience bringing a research prototype into sustained use.
-
Experience with robotics, real sensors, temporal data, or multi-sensor perception.
-
Familiarity with vision-language models, vision-language-action models, or embodied AI.
-
Experience with C++, edge inference, or model optimization using tools such as ONNX, TensorRT, or CUDA.
You don’t need to meet every preferred qualification or arrive as an expert C++ engineer. We welcome recent PhD graduates and early-career researchers, and we value technical depth, curiosity, and enthusiasm to transfer research to business value more than publication count alone.
Full-time regular employee offer package: Pay within range listed + Bonus + Benefits + Equity Temporary employee offer package: Pay within range listed above + temporary benefits package (applicable after 60 days of employment) Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information. ### Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.