AI Generalist for Prompt Evaluation

Only for registered members Canada

3 weeks ago

Default job background
$7 - $12 (USD) per hour
I am an AI generalist contractor for an AI company seeking someone to evaluate prompts and responses. The role involves assessing the quality and relevance of AI outputs to ensure they meet our standards. Attention to detail and understanding of AI systems are essential. This par ...
Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Work in company Remote job

    Prompt Evaluator

    Only for registered members

    We are hiring a Generalist Evaluator Expert to support a high-impact AI research initiative. · Design detailed prompts with multiple constraints and structured instructions · Author high-quality "golden answers" aligned to defined expectations · Develop comprehensive evaluation r ...

    3 weeks ago

  • Work in company Remote job

    Prompt engineering and evaluation specialist

    Only for registered members

    We are building an advanced AI-powered product for fintech, portfolio management, and hedging strategies targeted at small and mid-sized companies. · ...

    $25 - $47 (USD) per hour

    1 month ago

  • Work in company Remote job

    Finance LLM Reviewer/Evaluator prompt review

    Only for registered members

    To audit train and improve Large Language Models LLMs specialized in finance ensuring accuracy and mitigating risks. · Key Tasks Evaluating LLM outputs for accuracy logicality and reliability in financial tasks e.g trading reporting Developing Ground Truth data for fine-tuning mo ...

    $8 - $15 (USD) per hour

    1 month ago

  • Work in company

    Ingénieur Prompt

    Only for registered members

    **English version below** · Doit être local à Montréal · Vous souhaitez travailler dans le domaine de la technologie au sein d'une banque d'investissement? · Nous recherchons une personne pour rejoindre une équipe dynamique en tant que Ingénieur Prompt pour l'un de nos clients. · ...

    Montreal Full time

    14 hours ago

  • Work in company

    Développeur Python

    Only for registered members

    **English version below** · Doit être local à Montréal · Vous souhaitez travailler dans le domaine de la technologie au sein d'une banque d'investissement? · Nous recherchons une personne pour rejoindre une équipe dynamique en tant que Développeur Python pour l'un de nos clients. ...

    Montreal $65,000 - $110,000 (CAD) per year Full time

    14 hours ago

  • Work in company

    Senior Prompt Engineer

    Only for registered members

    About the Company: · Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code pl ...

    Toronto

    6 days ago

  • Work in company Remote job

    German Speaker for Testing Conversational AI

    Only for registered members

    We are looking for a German-speaking professional to test our conversational AI system. · ...

    $15 - $30 (USD) per hour

    1 month ago

  • Work in company Remote job

    Serbian Speaker for Testing Conversational AI

    Only for registered members

    Serbian-speaking professional needed for one-time project interacting with conversational system evaluating naturalness of Serbian voice output comparing against reference samples creating refining prompts text voice interactions. · ...

    $10 - $20 (USD) per hour

    1 month ago

  • Work in company

    Senior Prompt Engineer

    Only for registered members

    About the Company: · Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code pl ...

    Toronto Full time

    1 week ago

  • Work in company Remote job

    LLM Prompt Engineering

    Only for registered members

    We are building a GenAI-driven recommendation engine that generates structured recommendations by passing user context + prompts to LLMs and evaluating the output. · ...

    $30 - $50 (USD) per hour

    1 month ago

  • Work in company Remote job

    Prompt Engineer Needed to Improve AI Coaching Feature in our mobile app

    Only for registered members

    We're looking for an experienced prompt engineer to help us improve the output quality of an AI accountability coach feature inside our digital wellness iOS app. · Currently our output is not hitting the tone, depth, or personalization level we need. · The Project · Our AI coach ...

    4 days ago

  • Work in company Remote job

    AI Prompt Engineer

    Only for registered members

    We are looking for an experienced AI Trainer / Prompt Engineer to help train and align AI systems so that when users ask about Zangi, the responses are accurate, consistent, and brand-safe, · Train and finetune AI responses related to Zangi across common user queries · Define cor ...

    $20 - $400 (USD) per hour

    1 month ago

  • Work in company Remote job

    Voice Agent Prompt Engineer

    Only for registered members

    We are hiring an experienced Voice Agent Prompt Engineer to refine and productionize system prompts for a VAPI-based real-time voice agent, · use agent evaluation tools (e.g., Langfuse) to test, score and iteratively improve agent behavior until it meets strict business and conve ...

    $400 - $0 (USD) budget

    1 month ago

  • Work in company

    Rédacticien ou rédacticienne en requêtes IA, Copilot

    Only for registered members

    Rédacteur en requêtes IA pour accompagner lorganisation dans limplantation des solutions liées Microsoft Copilot. · • Évaluer la faisabilité technique des cas dusage identifiés par les conseillers. · • Concevoir tester documenter et promouvoir les cas dusage et les requêtes qui p ...

    Lévis

    1 month ago

  • Work in company Remote job

    AI Prompt Engineer

    Only for registered members

    AI Prompt Engineer - Agent Systems Consultant (Contract, Milestone Based) · We are building a fintech AI system using a multi-agent architecture where different AI agents perform specialized tasks across a workflow. · We are looking for an AI consultant / prompt engineer to help ...

    $11 - $13 (USD) per hour

    1 day ago

  • Work in company Remote job

    Prompt Engineering Expert for AI Model Testing

    Only for registered members

    We are seeking an expert in prompt engineering to test AI models for various affective scenarios. · Crafting and refining prompts to evaluate AI performance in emotional and social contexts is key, · Prompt EngineeringLLM PromptAi Model Training Prompt ...

    $500 - $0 (USD) budget

    1 month ago

  • Work in company

    Ingénieur AI

    Only for registered members

    + Implémentation de pipelines MLOps automatisés (CI/CD, données, entraînement) · + Implémenter des pipelines de ETL pour l'ingestion des données.+ Application des principes de gouvernance (biais, vie privée , transparence). + Collaboration avec data scientists pour transformer u ...

    Montreal

    2 weeks ago

  • Work in company

    Développeur GenAI

    Only for registered members

    + Implémentation de pipelines MLOps automatisés (CI/CD, données, entraînement). · + Implémenter des pipelines de ETL pour l'ingestion des données. · + Containerisation et déploiement de modèles en production. · + Surveillance continue des modèles (drift detection, alerting). · + ...

    Montreal

    2 weeks ago

  • Work in company Remote job

    Senior AI Prompt Engineer for Construction AI

    Only for registered members

    This role involves auditing and refining an existing prompt system to ensure zero hallucinations, domain-accurate language, and deterministic outputs. · You'll work on generating customer-facing and internal documents. · Candidates will be evaluated on their problem-solving skill ...

    $30 - $80 (USD) per hour

    1 month ago

  • Work in company

    GenAI Prompt Engineer

    Only for registered members

    Job Title: GenAI Prompt Engineer · Location: Montreal, QC (4x onsite a week) · Employment Type: Contract · Pay Rate: CAD$45 - $50/HR INC · Interview Type: Face 2 Face (Onsite Interview Only) · Job Description · Primary Responsibilities · The developer will be working within a mac ...

    Montreal

    1 week ago