Software Engineer, AI - Toronto

At Klue, We're Building the Future of Competitive Intelligence · Klue Engineering is hiring · We're looking for a Software Engineer, AI to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflow ...

Job description

At Klue, We're Building the Future of Competitive Intelligence

Klue Engineering is hiring

We're looking for a Software Engineer, AI to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users.

You'll be joining us at an exciting time as we reinvent our insight generation systems, making this an excellent opportunity for someone with strong Backend and ML fundamentals who wants to dive deep into practical LLM applications.

As a member of our team, you'll be leading the design and implementation of search and retrieval agent systems that enable users to discover high-quality, relevant information with minimal effort.

You will work at the intersection of LLM-powered agent workflows, retrieval pipelines, and evaluation frameworks, ensuring that our systems remain scalable, efficient, and aligned with user intent.

What You'll Do

Design and implement retrieval-augmented generation (RAG) systems with agentic workflows to refine query understanding, document retrieval, and response synthesis.
Build and optimize retrieval pipelines using BM25, dense retrieval, hybrid retrieval, and re-ranking approaches.
Develop evaluation pipelines for retrieval and generation, including offline metrics (recall, MRR, nDCG) and human-in-the-loop evaluations.
Experiment with query rewriting, expansion, and classification to improve retrieval relevance.
Collaborate closely with Product to bring ML-powered search agents into production.
Profile, debug, and optimize the latency, accuracy, and scalability of retrieval and generation components.

Contribute to the design of data pipelines for training retrieval and ranking models, including dataset curation, augmentation, and labeling workflows.

Stay up-to-date with advancements in LLMs, retrieval techniques, and agent architectures, evaluating opportunities to integrate them into our systems.

What You Bring

5+ years of software engineering experience
Experience with information retrieval systems, search relevance, and ranking models
Expertise in Python, with experience in frameworks such as PyTorch, TensorFlow, or JAX.
Familiarity with LLMs, prompt engineering, and retrieval-augmented generation pipelines.
Understanding of evaluation methods for search systems, including offline metrics and user-facing evaluation.
Experience working with vector database infrastructure (FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch)
Understanding of data pipelines, preprocessing, and large-scale data handling.
Ability to work independently and collaboratively in a fast-paced environment, balancing research and production needs.
Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.
Knowledge of query understanding, document summarization and other content enrichment strategies
Expertise in automated LLM evaluation, including LLM-as-judge methodologies
Skilled at prompt engineering - including zero-shot, few-shot, and chain-of-thought.
Experience with cloud infrastructure (AWS, GCP, Azure) for scalable ML workflows.

Nice to Have

Experience with agentic system design for LLM workflows.
Background in conversational search.
Contributions to open-source projects in the retrieval, NLP, or LLM ecosystems.

What Success Looks Like


We're looking for builders who:
Take ownership and run with ambiguous problems
Jump into new areas and rapidly learn what's needed to deliver solutions
Bring scientific rigor while maintaining a pragmatic delivery focus
See unclear requirements as an opportunity to shape the solution

Our Tech Stack

LLM platforms:
OpenAI, Anthropic, open-source models

ML frameworks:
PyTorch, Transformers, spaCy


Search/Vector DBs:
Elasticsearch, Pinecone, PostgreSQL

MLOps tools:
Weights & Biases, MLflow, Langfuse

Infrastructure:
Docker, Kubernetes, GCP


Development:
Python, Git, CI/CD

Not ticking every box? That's okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above.

If you know you have what it takes, even if that's different from what we've described, be sure to explain why in your application.

At Klue, we're committed to building a high-performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential.

If there's anything we can do to make our hiring process more accessible or to better support you, please let us know, we're happy to accommodate.

Why Klue Might Be the Perfect Fit For You

At Klue, you'll push the boundaries of what's possible. For yourself, your team, and our customers. The environment here feels more startup than corporate. You'll roll up your sleeves, build, iterate, and level up. This is a place where your ideas matter, you can shape what comes next, and leave your mark.

If you're looking to join a category-defining company… where you own big outcomes, influence real customers, and work with smart, gritty people… you'll thrive here.

Unlock Your Potential. Take Risks. Take Action. Innovate

How We Work At Klue

We love the balance of connection and flexibility.

We work Office-First, with a hybrid touch, and work together in our vibrant offices on Mondays, Wednesdays & Thursdays to collaborate, brainstorm, and build together.

Our main hiring hubs are in:
Vancouver (HQ)
Toronto
London

Our Commitment to You

High Performance Culture. We reward high performance and growth through career development, coaching, and annual performance reviews.

Comprehensive benefits:
Extended health & dental coverage that starts on Day 1. Fun perks like discounts at Goodlife and Perkopolis are gravy.

Ownership:
All full-time employees have the opportunity to participate in our Employee Stock Option Plan.
Our Vacation Policy is Take The Time You Need. We just ask that you give notice and don't leave your team hanging.
Top-tier tools. All employees will receive a Mac (or PC, if that's your jam) and access to A+ tooling.
AI First. All employees are encouraged to lean into AI to work smarter and faster. Built something cool lately? Show us at our Friday Show, Don't Tell Meetings.
Growth / Leadership. Direct access to our leadership team, including our CEO, and opportunities to connect with incredible people across the company.
Social connection. There's no shortage of ways to stay connected and have fun. We get together once a year in Vancouver for a company- wide kickoff. Throughout the year our Hubs hold regular social events.
Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.

About Klue

We're on a mission to help organizations stop losing winnable deals. Klue's AI agents generate market, competitor, and buyer insights in a unified platform.

We ensure it's trustworthy, automated, and activated across every department, so they have the answers they need to own their market.

Here's what makes us tick:
Klue is AI-first at its core. It's wired deep into our internal processes and tooling, powering our small but mighty team.

It drives Klue's autonomous agents that handle the heavy lifting for customers:
collecting intel, generating insights, and ensuring content is updated and available across departments.

Our agents help them scale their impact, stay ahead of the market, and reclaim the time that used to be consumed by manual, repetitive busywork.

Competitor Insights.

Klue helps revenue teams win more competitive deals by turning market, competitor, and buyer signals into insights teams can actually use.

Our AI analyzes calls, CRM data, and real buyer feedback to give product marketers and sellers a clear picture of what's happening in their market and why deals are won or lost.

We're a curious, collaborative team building a platform that helps companies compete with confidence, and we're looking for people who want to do meaningful work alongside others who care about craft and impact.

A culture of curiosity, ownership and winning together. We're a fast-growing, globally-distributed team based in Vancouver (with hubs like Toronto), scaling quicker than ever. We value people who own their domain, act boldly, stay curious and thrive in a collaborative, high-performance environment.

Explore More

Klue Blog
Ignition Acquisition (2025)
Acquisition (2025)
Win-Loss Acquisition (2023)
Series A (2020)
Series B (2021)
Culture, culture, culture
Customer Stories
Glassdoor
About Us
Instagram
LinkedIn
Wellfound (AngelList)
Product Demo Arena

By submitting your application, you agree that Klue may collect your personal data for recruiting, global organization planning, and related purposes.

We may use automated or AI-assisted tools to support our recruitment process. All hiring decisions are made by our hiring team


Compensation Range:
CA$115K - CA$149K