- Build, optimize, and evolve RAG pipelines, including retrieval strategies, chunking, and re‑ranking
- Develop prompts and guardrails for domain‑specific LLM applications
- Implement hallucination detection, mitigation, and fact‑checking mechanisms
- Build embeddings‑based search and recommendation features
- Validate AI features with real users and iterate based on qualitative and quantitative feedback
- Set up and maintain LLM evaluation frameworks to measure quality, relevance, and reliability
- Implement observability and monitoring for production AI systems
- Monitor live AI systems and resolve quality, accuracy, and performance issues
- Continuously improve AI outputs based on evaluation data and user behavior
- Work closely with product and engineering teams to integrate AI into user‑facing features
- Build and maintain backend services in Python
- Integrate with vector databases to support retrieval and semantic search workflows
- Ensure AI solutions meet enterprise requirements for security, scalability, and maintainability
- Collaborate with cross‑functional partners across product, engineering, and design
- Operate effectively in environments with evolving requirements and ambiguity
- Communicate clearly with technical and non‑technical stakeholders
- Take ownership of delivery outcomes from experimentation through production
- 8+ years of professional software engineering experience, with 4+ years focused on applied AI/ML or data‑driven systems in production environments
- 3+ years building and operating production AI systems
- Strong hands‑on experience with LLM applications, including RAG, prompt engineering, and evaluation
- Experience implementing hallucination detection and mitigation techniques
- Proficiency in Python
- Experience working with vector databases (Weaviate, Pinecone, or similar)
- Experience with LLM evaluation frameworks (Langfuse, Weights & Biases, or custom solutions)
- Production experience using Claude and/or GPT APIs
- Strong understanding of embeddings and semantic search
- Comfortable working with ambiguity and iterating on unclear problems
- Bachelor's degree in computer science, Engineering, Data Science, or a related technical field, or equivalent practical experience
- Advanced degree (Master's or PhD) in a relevant field
- Experience with Azure AI services, including Azure OpenAI and Cognitive Services
- Experience with document processing (PDF extraction, OCR)
- Exposure to audio or speech processing (e.g., Whisper or similar tools)
- Experience building enterprise B2B software
- Experience with ML classification and model training
- Evaluation & Observability: Langfuse or similar
- You are hands‑on and delivery‑focused, writing code and owning outcomes
- You balance speed with quality in production environments
- You communicate clearly and collaborate effectively across disciplines
- You take ownership of ambiguous problems and drive them to resolution
- You prioritize reliability, maintainability, and real‑world impact
- Real production impact not a POC that sits on a shelf
- Exposure to the full AI lifecycle: RAG, LLM applications, evaluation, classification, and monitoring
- End‑to‑end ownership of the AI stack and technical decision‑making
- A small, senior team with direct access to enterprise clients
-
Data Engineer
3 weeks ago
Only for registered members Calgary, AlbertaOn compte sur toi pour innover pas seulement entretenir. · ...
-
Data Engineer
5 days ago
Only for registered members CalgaryAteko recrute un ingénieur de données pour renforcer ses capacités en matière d'intelligence artificielle et d'analytique de données. Le candidat travaillera sur des défis de données à grande échelle et collaborera avec les équipes techniques pour assurer la qualité et la conform ...
-
Sales Engineer
1 week ago
Only for registered members Calgary $75,000 - $90,000 (USD)L'ingénieur(e) commercial() chez Global Payments joue un rôle essentiel en faisant le lien entre les solutions techniques et les besoins des clients. Il/elle travaille étroitement avec l'équipe commerciale pour comprendre et répondre aux besoins. · Cette personne est chargée de g ...
-
Data Engineer
3 weeks ago
Only for registered members CalgaryOn compte sur toi pour innover, pas seulement entretenir. Ce rôle est essentiel pour gérer le cycle de vie complet des données, de l’ingestion et la transformation jusqu‐à l„analytique et la gouvernance, au sein d‗écosystèmes infonuagiques modernes. · ...
-
Lead Process Engineer
6 days ago
Only for registered members Calgary, AB, Canada+Job summary · Aperçu du poste · This is a senior individual-contributor role with a strong emphasis on hands-on process design, technology integration, and facility optimization. · +Experience: · Bachelor's, Master's or PhD in Chemical Engineering or related field. · ...
-
Senior Electrical Engineer
1 month ago
Only for registered members CalgaryRejoignez l'une des plus grandes sociétés de conseil en énergie renouvelable au monde, dédiée à la promotion d'une transition énergétique juste et à l'atténuation du changement climatique · ...
-
Senior Software Engineer
1 month ago
Only for registered members Calgary $98,600 - $144,650 (CAD)Au poste de Senior Software Engineer, vous travaillerez avec l'équipe Autodesk Alias pour développer des logiciels de pointe pour la conception automobile et industrielle. Vous gérerez les fonctionnalités liées à l'amélioration du solveur de contraintes géométriques développé en ...
-
Forensic engineer, fire and explosion
1 month ago
Only for registered members Calgary $101,800 - $124,400 (CAD)W e are seeking two Forensic Engineers, Fire and Explosion—one based in Calgary and one in Edmonton—for our Claims Department to support our growth. · ...
-
Forensic engineer, fire and explosion
1 month ago
Only for registered members Calgary+Job summary · Nous sommes à la recherche d'ingénieur forensique chargé des incendies et explosions pour soutenir notre croissance. · + Compléter des assignations pour nos ajusteurs internes et externes ainsi que nos agents immobiliers. · Renseigner sur place afin de déterminer ...
-
Engineering Manager
1 month ago
Only for registered members Calgary, AlbertaWe are recruiting an Engineering Manager to lead multi-disciplinary engineering teams and drive project delivery excellence. · ...
-
Electrical Engineer
2 weeks ago
Only for registered members Greater Calgary Metropolitan AreaWe are seeking an Intermediate to Senior Electrical Engineer to join our tight-knit Calgary team. · This is a hands-on, cradle-to-grave engineering role suited for someone who enjoys ownership, collaboration, · and working on technically challenging projects. ...
-
Mechanical Engineer
1 week ago
Only for registered members Calgary, AB, CanadaWe are seeking a Mechanical Engineer who will work with members of the engineering team in order to develop engineering design solutions appropriate to the context budget and aesthetic requirements of building projects. · ...
-
Piping Engineer
4 days ago
Only for registered members Calgary, AlbertaWe are seeking a Full-Time Piping Engineer (P.Eng.) to work out of our customer's downtown Calgary office. · Ensure compliance with all Health, Safety, and Environment (HSE) requirements · Perform detailed piping engineering functions to deliver high-quality, constructible design ...
-
Project Engineer
1 month ago
Only for registered members Calgary, AlbertaAplin has partnered with an established Calgary-based organization to recruit a Project Engineer. The Intermediate Engineer will be responsible for and/or support the administration, engineering design, contract preparation, tendering/procurement, project management and quality c ...
-
Structural Engineer
2 weeks ago
Only for registered members Calgary, ABRoska DBO Inc. is currently seeking a Structural Engineer to work out of our customer's downtown Calgary office. · ...
-
Mechanical Engineer
3 weeks ago
Only for registered members Calgary, AlbertaWe are proud to partner with a leading consulting engineering firm in the search for a talented Mechanical Engineer to join their dynamic team in Calgary. The role would involve working on government, multi-family and institutional work. · ...
-
HVAC Engineer
2 weeks ago
Only for registered members Calgary, ABRoska DBO Inc. is seeking a Full-Time HVAC Engineer to work out of their downtown Calgary office. · ...
-
Observability Engineer
6 days ago
Sepal CalgaryWe are looking for an Observability Engineer with 3+ years of experience to help us understand, debug, and operate complex production systems at scale. · ...
-
GenAI Engineer
2 weeks ago
Only for registered members Calgary, Alberta/b>Job summary: · About the Role: · An Automation Engineer responsible for designing, developing, and deploying GenAI/LLM-driven solutions using Python, ML, and modern cloud-native architectures.The role involves building scalable AI services, integrating oil & gas data systems, ...
-
Pipeline Engineer
1 week ago
Only for registered members Greater Calgary Metropolitan AreaWe are looking for a Pipeline Engineer to join our Projects team in Calgary or Edmonton. The candidate will ensure safe, compliant, and innovative pipeline design while supporting construction execution across multiple initiatives. · ...
-
Mechanical Engineer
1 week ago
Only for registered members Calgary, AB+Mechanical Engineer · A Mechanical Engineer will support the design, development, and execution of mechanical systems and equipment for Carbon Upcycling's pilot, demonstration, and commercial-scale facilities. · ...
AI Engineer - Calgary - Robots and Pencils
Description
At Robots & Pencils, we build meaningful, scalable digital products by blending strategy, design, and engineering. We are seeking a Level 4 AI Engineer to build production LLM applications for an enterprise client as part of a long-term, delivery-focused engagement.
You will own the AI stack end-to-end, including RAG pipelines, prompt engineering, and evaluation frameworks. This is a hands‑on role: you will write production code, tune prompts, build evaluation and observability systems, and iterate based on real user feedback.
There is a working proof of concept in place. Your responsibility is to make it production‑ready and extend it with intelligent, reliable features that operate at enterprise scale.
What You'll Do
AI & LLM Application Delivery
Evaluation, Monitoring & Reliability
Platform & System Integration
Delivery & Collaboration
Required Skills & Experience
Nice to Have
How You Work
Why Robots & Pencils
#J-18808-Ljbffr
-
Data Engineer
Only for registered members Calgary, Alberta
-
Data Engineer
Only for registered members Calgary
-
Sales Engineer
Only for registered members Calgary
-
Data Engineer
Only for registered members Calgary
-
Lead Process Engineer
Only for registered members Calgary, AB, Canada
-
Senior Electrical Engineer
Only for registered members Calgary
-
Senior Software Engineer
Only for registered members Calgary
-
Forensic engineer, fire and explosion
Only for registered members Calgary
-
Forensic engineer, fire and explosion
Only for registered members Calgary
-
Engineering Manager
Only for registered members Calgary, Alberta
-
Electrical Engineer
Only for registered members Greater Calgary Metropolitan Area
-
Mechanical Engineer
Only for registered members Calgary, AB, Canada
-
Piping Engineer
Only for registered members Calgary, Alberta
-
Project Engineer
Only for registered members Calgary, Alberta
-
Structural Engineer
Only for registered members Calgary, AB
-
Mechanical Engineer
Only for registered members Calgary, Alberta
-
HVAC Engineer
Only for registered members Calgary, AB
-
Observability Engineer
Sepal- Calgary
-
GenAI Engineer
Only for registered members Calgary, Alberta
-
Pipeline Engineer
Only for registered members Greater Calgary Metropolitan Area
-
Mechanical Engineer
Only for registered members Calgary, AB