Literary Critic for LLM Benchmarks

We're looking for an LLM Evaluation, Benchmarking & Experimentation Engineer to rigorously test our proprietary LLM API and build the infrastructure for systematic model improvement. · ...

+I'm seeking a technical mentor to help deepen my understanding of LLM evaluation and benchmarking, with particular attention to high-stakes applications (e.g., mental health), while developing a generalizable framework for reasoning about model performance across domains. · ...

We are seeking a skilled Technical Creative Writing Benchmark Developer to help us benchmark large language models (LLMs) with 30 hours per week. · Mandatory skills: · Creative Writing · Content Writing · Search Engine OptimizationWriting ...

+We are seeking an AI Engineer with expertise in creating benchmarks for large language models (LLMs) who also has a passion for creative writing and story development. · +Creative Writing li>, Mandatory skills: Creative Writing, Writing, Content Writing li>, Adobe Illustrator li ...

We are seeking a skilled professional to create a comprehensive Discovery and Architecture Document for LLM Robot Workers. · This project will include cost and quality benchmarking, · along with guidelines for secure deployment. · The ideal candidate will have experience in LLM t ...

We are seeking a talented creative writer who possesses a strong statistical background to develop benchmarks for large language model output evaluation.Develop benchmarks for LLM output evaluation · ...

We are seeking an expert to assist with our sorting with LLM project. The ideal candidate will have experience integrating benchmark datasets and connecting to open-source models using the existing codebase. · ...

We are seeking an expert in AI chatbot development with a strong understanding of language models. · ...

We need a data scientist to prove our AI works — with data, not marketing. You'll design and run evaluations that compare ZeroDrift's compliance detection against raw LLMs (GPT-4, Claude). ...

Bond Studio makes software that lets users capture their space with their phone and see a visualization of how that room could look if it were remodeled. Users can browse products, select them and see them visualized in their space. Part of this experience is search where users c ...

We are building a serious AI product focused on transforming real-world business conversations into structured intelligence insights and automation. · AI pipelines that analyze recorded conversations speech text structured insights · LLM-based systems for summarization classifi ...

We are seeking an experienced Legal AI Evaluator to join our team at Mercor. The ideal candidate will have a strong background in law and experience working with large language models. · ...

We are seeking an experienced developer to optimize our AI-powered coding agent engine. · Mandatory skills: Python, LLM Prompt Engineering, AI Agent Development · ...

We are seeking a highly skilled GenAI / AI Engineer to design build and deploy cutting-edge generative AI solutions that address real-world business challenges. · ...

We're looking for a GEO (Generative Engine Optimization) expert with proven experience in SaaS and/or Education platforms to conduct an audit of how a large international EdTech SaaS product is currently represented and recommended inside LLMs and AI-powered search experiences. · ...

This is a freelance opportunity to build an AI workflow for strategy reports. · The client has existing assessment logic and narrative frameworks in place. · ...

We are looking for an experienced Mechanical Engineering Consultant to join our team. · ...

Evaluate LLM-generated responses for effectiveness in answering user queries. · Evaluate model responses align with expected conversational behavior and system guidelines. ...

+Mercor connects elite creative and technical talent with leading AI research labs. · +Bachelor's degree · Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in French · +,valid_job:1} ...

About Mercor connects elite creative and technical talent with leading AI research labs. We are looking for an experienced Conversational AI Evaluator to join our team. · Evaluate LLM-generated responses for effectiveness in answering user queries. Conduct fact-checking using tru ...