Senior Researcher - Edge AI Optimization/Hardware-Aware ML
At a glance
Senior AI Research role at Huawei Technologies Canada Co., Ltd. Edmonton · full-time · no salary stated · we estimate CA$151,100–CA$175,975 across Canada.
Huawei Technologies Canada Co., Ltd. has not published a salary for this role. The figure below is our estimate, not theirs.
aimlroles summary, based on the employer's posting.
What you'll do
- Research ways to make neural networks more hardware-aware, including quantization, pruning, distillation and architecture search
- Build and test inference methods that balance accuracy, latency, energy use and memory limits on edge devices
- Trace device performance and improve inference pipelines, targeting issues such as memory bandwidth and kernel overhead
- Create edge-device benchmarks and deployment plans for systems using CPUs, GPUs and NPUs
- Work with product, platform and hardware teams to move research prototypes toward production, while mentoring junior colleagues
What you bring
- A PhD or comparable research background in machine learning, computer science, electrical or computer engineering, or a related area
- At least two years of relevant research or industry work, with demonstrated results in an edge-efficiency area
- Strong Python and C/C++ skills, plus experience with deep-learning frameworks and deployment toolchains
- A publication record at leading research venues or patents related to ML efficiency
Who this fits
This senior research role suits someone focused on hardware-aware ML, edge inference and rigorous performance measurement. The position is onsite in Edmonton. You’ll also guide junior researchers and engineers while contributing to technical direction.
From the employer
Huawei Canada has an immediate permanent opening for a Researcher.
About the team:
The Software-Hardware System Optimization Lab focuses on research and innovation in power efficiency and performance optimization for consumer devices. By leveraging the talents and capabilities of local academia and our team, we aim to build system-optimization capabilities for software and hardware across edge AI, multimedia, graphics, mobile gaming, and system software domains, thereby enhancing the user experience and performance competitiveness of Huawei's consumer device products.
About the job:
Conduct research in hardware-aware neural network optimization (e.g., quantization-aware training, mixed precision, pruning, distillation, neural architecture search).
Develop novel approaches for latency/energy-aware training objectives and Pareto optimization (accuracy vs. compute vs. memory).
Prototype and evaluate techniques for efficient inference under device constraints (thermal limits, memory bandwidth, intermittent connectivity).
Publish and present findings internally and externally (papers, workshops, patents, technical blogs).
Optimize inference pipelines across pre/post-processing, scheduling, operator fusion, memory planning, and runtime execution.
Collaborate on or contribute to compilers / runtimes (e.g., TVM, MLIR, XLA, TensorRT, ONNX Runtime, TFLite, ExecuTorch) to improve operator coverage and performance.
Profile and optimize models with real device traces, addressing bottlenecks such as cache misses, memory bandwidth, kernel launch overhead, and CPU–NPU handoff.
Build and maintain hardware-aware benchmarking methodology and regression suites for edge targets (ARM CPU, mobile GPU, DSP, NPU).
Create deployment recipes for heterogeneous compute (CPU+GPU+NPU) including partitioning strategies and fallback paths.
Drive optimization for on-device personalization and incremental updates when needed (e.g., small adapters, efficient fine-tuning).
Partner with product engineering, platform teams, and hardware teams to translate device constraints into research targets and to transition research prototypes into production.
Mentor junior researchers/engineers, review experimental designs, and raise the quality bar for measurement rigor and reproducibility.
Define technical roadmap areas (e.g., next-gen quantization, kernel optimization, model families for edge, compiler improvements).
About the ideal candidate:
PhD (or equivalent research experience) in Machine Learning, Computer Science, Electrical/Computer Engineering, or related field.
Strong programming skills in Python and C/C++ (or equivalent systems language).Experience building AI agent / harness / skill toolchains, including model evaluation, orchestration, and LLM-powered tooling. Hands-on experience with deep learning frameworks (e.g., PyTorch, TensorFlow, JAX) and deployment toolchains (e.g., ONNX, TFLite, TensorRT, TVM, MLIR-based stacks). Solid knowledge of performance profiling: latency measurement, memory profiling, kernel-level bottleneck analysis, and experimental rigor.
Proven publication record at top venues (e.g., NeurIPS/ICML/ICLR, MLSys, ASPLOS, ISCA, MICRO) and/or patents in ML efficiency.
2+ years of relevant experience (research lab or industry) with demonstrated impact in at least one of:
Model compression (quantization/pruning/distillation)
Efficient architectures (MobileNet-like, MoE, efficient transformers, etc.)
ML systems/compilers/runtime optimization
hardware-aware optimization for edge deployment
Experience optimizing for specific edge hardware:
ARM NEON, mobile GPUs, DSPs, NPUs, microcontrollers
Experience with distributed benchmarking, CI for performance regression, and reproducible experiment pipelines.
Understanding of power/thermal constraints and methodologies for measuring energy on device.
Experience with efficient LLM/VLM inference on edge (KV-cache optimization, quantized attention, speculative decoding, etc.).
Technical Skills:
Quantization: PTQ/QAT, per-channel/per-tensor, calibration, smooth quant, GPTQ-like methods, mixed precision
Sparsity: structured pruning, N: M sparsity, hardware-friendly sparsity
Compiler techniques: graph rewriting, operator lowering, scheduling, kernel autotuning
Runtime techniques: memory arenas, tensor lifetime analysis, static vs dynamic shapes, batching strategies
Hardware fundamentals: cache hierarchy, SIMD, memory bandwidth, accelerator programming models
Additional Information:
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.