Senior Machine Learning Applications and Compiler Engineer, Senior Machine Learning Applications and Compiler Engineer - Toronto

Only for registered members Toronto, Canada

2 days ago

Default job background
$135,000 - $220,000 (CAD)
We are now looking for a Senior Machine Learning Applications and Compiler Engineer · NVIDIA is seeking engineers to develop algorithms and optimizations for our inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning, ...
Job description
We are now looking for a Senior Machine Learning Applications and Compiler Engineer

NVIDIA is seeking engineers to develop algorithms and optimizations for our inference and compiler stack.

You will work at the intersection of large-scale systems, compilers, and deep learning, crafting how neural network workloads map onto future NVIDIA platforms.

This is your chance to be part of something outstandingly innovative

What You'll Be Doing

Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
Define and implement mappings of large-scale inference workloads onto NVIDIA's systems.

Extend and integrate with NVIDIA's SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.

Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.

Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.

Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.

Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.

What We Need To See


MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.

Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.

Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.

Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.

Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.

Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.

Ways To Stand Out From The Crowd

Prior work on spatial or dataflow architectures, including static scheduling, pipeline parallelism, or tensor parallelism at scale.
Contributions to opensource ML frameworks, compilers, or runtime systems, particularly in areas related to performance or scalability.

Demonstrated research impact, such as publications or presentations at conferences like PLDI, CGO, ASPLOS, ISCA, MICRO, MLSys, NeurIPS, or similar.

Experience with large-scale AI distributed inference or training systems, including performance modeling and capacity planning for multi rack deployments.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until February 8, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

, , JR2012562


Similar jobs

  • Work in company

    Compiler Engineer

    Only for registered members

    About OLIX · AI is growing faster than any technology in history and the explosion in demand has created a massive infrastructure gap; we can no longer build chips or power stations fast enough to keep up. · ...

    Toronto, Ontario

    1 week ago

  • Work in company

    Compiler Engineer

    Only for registered members

    We're searching for Senior Compiler Engineers to join the team building the ML backend (compiler, run-time, and debugger) for our next-generation OPTUs that connect PyTorch, Tensorflow, JAX, and MXNet down to our low-level kernel drivers. · Project Ownership: Own and deliver proj ...

    Toronto

    4 days ago

  • Work in company

    Compiler Engineer

    Only for registered members

    About OLIX AI is growing faster than any technology in history. We are building the next paradigm; the Optical Tensor Processing Unit (OTPU) achieves performance and energy efficiency impossible to match from existing chips. · Project Ownership: Own and deliver projects on your t ...

    Toronto Full time

    1 week ago

  • Work in company

    Compiler Engineer

    Only for registered members

    +Join us at Intel where we are at the cutting edge of software innovation building the next generation of technology through the oneAPI software stack Our mission is to unlock the full potential of heterogeneous computing enabling developers worldwide to harness the power of CPUs ...

    Toronto $114,890 - $162,190 (CAD) Full time

    1 week ago

  • Work in company

    Compiler Engineer

    Only for registered members

    We are seeking a motivated and experienced Compiler Engineer to join our high-performing Intel Compiler Engineering Team. · ...

    Toronto $155,888 - $220,069 (CAD) Full time

    1 week ago

  • Work in company

    Compiler Engineer

    Only for registered members

    The Compiler Team at Intel seeks a Compiler Engineer to develop syntax and semantic processing support for the industry-leading Intel Fortran compiler. · ...

    Toronto $155,888 - $220,069 (CAD) Full time

    1 week ago

  • Work in company

    AI Compiler Engineer

    Only for registered members

    We're working with a well-funded, · fast-growing AI hardware company building an open, · high-performance compute platform that spans · custom silicon,RISC-V CPUs,and a modern MLIR-based compiler stack. · Multiple openings across shows and experience levels · ...

    Toronto, Ontario

    1 month ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    +We're searching for Senior Compiler Engineers to join the team building the ML backend (compiler, run-time, and debugger) for our next-generation OPTUs that connect PyTorch, · Tensorflow,JAX,and MXNet down to our low-level kernel drivers.Your mission will be to create seamless s ...

    Toronto

    2 weeks ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    We're searching for Senior Compiler Engineers to join the team building the ML backend (compiler, run-time, and debugger) for our next-generation OPTUs that connect PyTorch, Tensorflow, JAX, · JAX and MXNet down to our low-level kernel drivers. · About OLIX · AI is growing faster ...

    Toronto, Ontario

    3 weeks ago

  • Work in company

    Engineering Manager, Compiler

    Only for registered members

    About OLIX: AI is growing faster than any technology in history. We are building the Optical Tensor Processing Unit (OTPU) that achieves performance and energy efficiency impossible to match from existing chips. · You will lead and scale Olix's Compiler & Performance Modelling te ...

    Toronto, Ontario

    3 weeks ago

  • Work in company

    ML Compiler Engineer

    Only for registered members

    We are hiring senior compiler engineers to solve our customers' toughest problems. This is an opportunity to work on innovative products at the intersection of machine-learning, high-performance computing, and distributed architectures. · ...

    Toronto, Ontario

    1 month ago

  • Work in company

    ML Compiler Engineer

    Only for registered members

    Job summary · Work at the intersection of machine learning high-performance computing and distributed architectures architect and implement business-critical features publish research and mentor a brilliant team of experienced engineers work closely with customers on their model ...

    Toronto, Ontario

    3 weeks ago

  • Work in company

    Engineering Manager, Compiler

    Only for registered members

    You will lead and scale Olix's Compiler & Performance Modelling teams, the groups defining and pushing the boundaries of what's possible with our OTPUs, and realize it through the design and delivery of our compiler stack. · ...

    Toronto

    2 weeks ago

  • Work in company

    LLVM Compiler Engineer

    Only for registered members

    We are seeking a Compiler Engineer to help design and implement new features in our low-level compiler toolchain including the compiler mid-end, backend, assembler, and linker targeting individual cores in this unique architecture. · Bachelor's, Master's, PhD or foreign equivalen ...

    Toronto

    1 week ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    The Senior Compiler Engineer role is available at Intel's Software and AI Group in Toronto, Canada. The team creates industry-leading compilers for C/C++, DPC++, and Fortran languages. · ...

    Toronto $155,888 - $220,069 (CAD) Full time

    1 week ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    We're working with a group of well-funded hardware companies building next-generation compute platforms in Toronto. · We're looking for Senior Compiler Engineers to join teams tackling problems at the intersection of software and performance-critical systems. · ...

    Toronto

    1 month ago

  • Work in company

    AI Compiler Engineer

    Only for registered members

    We're working with a well-funded AI hardware company building an open compute platform based in Toronto. · They're looking for Senior to Staff-level AI Compiler Engineers to join teams working at the intersection of machine learning compilers and cutting-edge hardware. · ...

    Toronto

    1 month ago

  • Work in company

    ML Compiler Engineer

    Only for registered members

    We are hiring senior compiler engineers to solve our customers toughest problems on innovative products at the intersection of machine-learning, high-performance computing, and distributed architectures. · ...

    Toronto

    1 month ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    We are continually pushing the boundaries of compiler technology in support of providing maximally useful and performant compilers for all of Intel's processor platforms, both CPU and GPUs. · In this role you will help us to provide strong support for the Intel Compiler products ...

    Toronto $155,888 - $220,069 (CAD)

    2 weeks ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    We're searching for Senior Compiler Engineers to join the team building the ML backend (compiler, run-time, and debugger) for our next-generation OPTUs that connect PyTorch,Tensorflow,JAX,and MXNet down to our low-level kernel drivers. · Your mission will be to create seamless su ...

    Toronto Full time

    3 weeks ago

  • Work in company

    Senior Compiler Engineer

    Only for registered members

    The Compiler Engineering team in Software and AI Group at Intel has an opportunity available for a Senior Compiler Engineer. · ...

    Toronto $155,888 - $220,069 (CAD) Full time

    2 weeks ago