Applied Scientist, AI Risk - Toronto - Armilla AI

    Armilla AI
    Armilla AI Toronto

    3 days ago

    Description

    Armilla AI is a cutting-edge startup at the intersection of artificial intelligence and insurance. Based in Toronto, Ontario, Canada, we're building innovative solutions to manage, underwrite, and insure the rapidly evolving risks associated with AI systems. We're a dynamic team passionate about pioneering the future of AI risk management.

    The Role


    We're seeking an exceptional Applied Scientist who bridges the worlds of deep AI research and practical, production-grade applications. As our Applied Scientist, AI Risk, you'll be instrumental in both advancing our understanding of AI systems and translating that knowledge into robust risk assessment and evaluation frameworks. This isn't just about building models— it's about understanding their failure modes, vulnerabilities, and real-world reliability. You'll develop AI systems that evaluate other AI systems, creating the next generation of automated risk assessment tools. You'll be shaping how the insurance industry evaluates and prices AI risk.

    Role Responsibilities

    • Conduct deep technical research into AI model behavior, failure modes, and edge cases, with a focus on practical risk assessment as well as deep research.
    • Design and develop AI systems—including specialized models, agents, and automated evaluation pipelines—that assess the safety, reliability, and risk profiles of other AI systems.
    • Build production-grade tooling and platforms for automated AI risk assessment, model testing, and continuous monitoring.
    • Evaluate diverse AI systems—from traditional ML models to Large Language Models and multimodal systems—identifying insurable risks, vulnerabilities, and potential failure scenarios.
    • Develop novel evaluation methodologies and metrics that capture AI-specific risks such as adversarial vulnerabilities, distribution shift, hallucinations, and behavioral misalignment.
    • Collaborate closely with our underwriting and actuarial teams to translate technical findings into actionable risk insights and pricing signals.
    • Stay at the forefront of AI research and safety literature, rapidly prototyping and validating new risk assessment techniques.
    • Write clean, maintainable, and well-tested code that scales from research prototypes to production systems.
    • Communicate complex technical concepts clearly to diverse stakeholders, from engineers to underwriters to executive leadership.

    What We're Looking For

    • Advanced degree (Master's or PhD) in Computer Science, Machine Learning, Statistics, or related field, with demonstrated research experience in AI/ML.
    • Strong track record of applied research—you've published, contributed to open source, or shipped ML products that had real-world impact beyond academic settings.
    • Deep technical expertise in machine learning fundamentals, including both classical ML and modern deep learning approaches.
    • Experience building AI/ML systems from conception to deployment, not just running evaluations on existing models.
    • Hands‑on experience with model evaluation, testing, and validation—you think critically about where models fail, not just where they succeed.
    • Solid software engineering skills with expertise in Python and experience with ML frameworks (PyTorch, TensorFlow, JAX) and scientific computing libraries (NumPy, Pandas, Scikit‑learn).
    • Experience with LLMs and generative AI, including familiarity with their unique risks, evaluation challenges, and safety considerations.
    • Background in AI safety, robustness, interpretability, or adversarial ML is a significant asset.
    • Ability to work both independently on deep technical problems and collaboratively in a fast‑paced startup environment.
    • Intellectual curiosity about the "other side"—not just building AI, but understanding its risks, limitations, and societal implications.
    • Strong problem‑solving abilities and attention to detail, with a pragmatic approach to balancing research rigor with business needs.

    What's In It For You

    • Pioneering a New Frontier: You'll be at the forefront of an emerging field, defining how AI systems are evaluated, understood, and insured at scale.
    • Dual‑Sided Impact: Work on both the technical frontier of AI evaluation and the practical challenge of real‑world risk assessment—a rare combination.
    • Meta‑AI Challenge: Tackle the fascinating problem of building AI systems that understand and evaluate other AI systems.
    • Impactful Work: Your research and tooling will directly shape how AI risk is quantified and managed across industries.
    • Startup Agility: Enjoy the fast‑paced, innovative, and collaborative culture of a growing startup where your ideas can quickly become reality.
    • Professional Growth: Unparalleled opportunities to develop expertise at the intersection of AI research, risk management, and insurance alongside deeply experienced AI and industry experts.
    • Technical Freedom: Latitude to pursue novel research directions and evaluation approaches that advance both the field and our business.

    #J-18808-Ljbffr

  • Senior Data Scientist, Risk

    2 weeks ago

    Only for registered members Toronto, ON

    We're reimagining financial services to give every Canadian their fair shake. · Analyze fraud, scam and abuse patterns across crypto and fiat products · Evaluate and iterate on risk rules and controls using rigorous analysis · ...

  • Applied Scientist, AI Risk

    3 days ago

    Only for registered members Toronto, Canada

    We are seeking an exceptional Applied Scientist who bridges the worlds of deep AI research and practical production-grade applications. As our Applied Scientist, AI Risk, you will be instrumental in both advancing our understanding of AI systems and translating that knowledge int ...

  • Senior Actuarial Data Scientist, AI Risk

    1 month ago

    Only for registered members Toronto, Ontario

    We're on the hunt for a truly unique individual – a "unicorn" who seamlessly blends deep actuarial expertise with robust Artificial Intelligence and Machine Learning capabilities. · Assess and evaluate AI models · to identify insurable risks, potential vulnerabilities, and failur ...

  • Senior Actuarial Data Scientist, AI Risk

    3 days ago

    Only for registered members Toronto, Canada

    We're on the hunt for a truly unique individual – a unicorn who seamlessly blends deep actuarial expertise with robust Artificial Intelligence and Machine Learning capabilities. · Assess and evaluate AI models to identify insurable risks. · Leverage your strong programming skills ...

  • Manager, Data Scientists,Global Risk Management

    1 month ago

    Only for registered members Toronto

    +Job Summary · We are looking for talented pragmatic analytically oriented data scientists who are equally at home interpreting and applying statistics as they are ingesting and massaging data, translating regulatory requirements into models and explaining complex issues in simpl ...

  • Manager, Data Scientists,Global Risk Management

    1 week ago

    Only for registered members Toronto

    We have decades of data powering hundreds of models deployed across a multitude of systems crying out for smart talented team players who are results-oriented embrace transformational challenges relish the opportunity to help us turn our vision into reality. · Achieving this requ ...

  • Manager, Data Scientists,Global Risk Management

    1 month ago

    Only for registered members Toronto, ON MH H

    We want talented pragmatic analytically oriented data scientists who are equally at home interpreting and applying statistics as they are ingesting and massaging data. · ...

  • Data Scientist, Model Risk

    2 weeks ago

    Only for registered members Oakville Full time

    We're Sagen Canada's leading private mortgage insurance company making home ownership more accessible to first time homebuyers. · Sagen is focused on being the most trusted partner for lenders and brokers Our expertise in superior customer service thought leadership and industry ...

  • Data Scientist, Model Risk

    2 weeks ago

    Only for registered members Oakville

    We are seeking a Data Scientist to support independent oversight of models across the organization by conducting rigorous technical validation and assessing model soundness performance and governance. · This role strengthens model transparency ensures appropriate model use and he ...

  • Data Scientist, Model Risk

    2 weeks ago

    Only for registered members Oakville, ON, Canada

    Ready to Make an Impact? · Reporting to the Director of Model Risk & Governance, · the Data Scientist supports independent oversight of models across the organization by conducting rigorous technical validation and assessing model soundness, performance, and governance.Collaborat ...

  • Data Scientist, Model Risk

    2 weeks ago

    Only for registered members Oakville, ON

    We are looking for a Data Scientist to support independent oversight of models across the organization by conducting rigorous technical validation and assessing model soundness, performance, and governance. · ...

  • Senior Credit Risk Data Scientist

    3 weeks ago

    Only for registered members Oakville Full time $64,000 - $106,000 (CAD)

    ++The purpose of the Credit Risk Management division of Canadian Tire Bank is to provide world class analytics to maximize our credit card portfolio profitability by balancing risk with reward potential and strengthening the customer relationship with Canadian Tire Corporation. · ...

  • Senior Credit Risk Data Scientist

    2 weeks ago

    Only for registered members Oakville Full time $64,000 - $106,000 (CAD)

    The role involves leading the development of predictive models for credit and collection risk information-driven strategies and managing delivery timelines. The position requires owning the full cycle scorecard design and development from target definition to implementation. · Un ...

  • Senior Credit Risk Data Scientist

    2 weeks ago

    Only for registered members Oakville, ON

    Lead the development of predictive models that will form the basis for information-driven strategies in credit and collection risk including managing delivery timelines and coordinating team resources Own the full cycle scorecard design and development from target definition and ...

  • Risk Management - Applied Machine Learning Scientist, Model Validation Intern/Co-op (Summer 2026)

    1 month ago

    Only for registered members Toronto, ON

    This internship opportunity allows you to gain valuable work experience across various businesses at TD Bank. As an Applied Machine Learning Scientist Model Validation Intern/Co-op, you will work with experienced colleagues, receive world-class training · ...

  • Manager, Data Scientists,Global Risk Management

    1 week ago

    Only for registered members (s): Canada : Ontario : Toronto

    We want talented pragmatic analytically oriented data scientists who are equally at home interpreting and applying statistics as they are ingesting and massaging data, translating regulatory requirements into models and explaining complex issues in simple concise ways. · We're lo ...

  • Risk Management - Applied Machine Learning Scientist, Model Validation Intern/Co-op (Summer 2026)

    1 month ago

    Only for registered members Toronto, Ontario

    The role involves working as an Applied Machine Learning Scientist for TD Model Validation group. As part of this team, you will be responsible for validating AI/ML models used across the Bank. · Validate (review, test, and provide effective challenge) AI/ML models. · Stay up to ...

  • Senior Applied Machine Learning Scientist, Insider Risk and Trading Surveillance Model Validation

    2 days ago

    Only for registered members Toronto $108,800 - $163,200 (CAD)

    This Senior Applied Machine Learning Scientist will lead a team of quantitative professionals to validate Financial Crime Risk Management (FCRM) models for Trading Surveillance and Insider Risk Management · Post-secondary degree in one or more of the following areas: computer sc ...

  • Senior Applied Machine Learning Scientist, Insider Risk and Trading Surveillance Model Validation

    4 days ago

    Only for registered members Toronto $108,800 - $163,200 (CAD)

    +The position reports to AVP, TBSM / FCRM/ TDAM/TDI Model Validation group. The role involves leading a team of quantitative professionals to validate Financial Crime Risk Management (FCRM) models for Trading Surveillance and Insider Risk Management. · +Lead a team of quantitativ ...

  • Risk Management - Applied Machine Learning Scientist, Model Validation Intern/Co-op (Summer 2026)

    1 month ago

    Only for registered members Toronto $45,700 - $74,400 (CAD)

    +This internship provides a valuable work experience across various businesses at TD Bank, allowing you to gain skills in machine learning methodologies. · + · +)The Artificial Intelligence/Machine Learning (AI/ML) MV team validates AI/ML models used across the bank for various u ...

  • Risk Management - Applied Machine Learning Scientist, Model Validation Intern/Co-op (Summer 2026)

    3 weeks ago

    Only for registered members Toronto $45,700 - $74,400 (CAD)

    a Summer/Term 3 internship/co-op role in Risk Management - Applied Machine Learning Scientist Model Validation at TD Bank in Toronto, Ontario. · Validate AI/ML models particularly Generative AI including RAG and/or Agentic AI use cases. · Stay up to date with advancements in the ...

Jobs
>
Toronto