Set up LangFuse and help with LLM evals
1 month ago

Set up LangFuse for evaluating LLM prompts.
+Responsibilities
- Evaluate LLM prompts using LangFuse.
Job description
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.
Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.
Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Access all high-level positions and get the job of your dreams.
Similar jobs
Senior AI Engineer for LLM/RAG Systems
3 weeks ago
We are seeking a senior-level expert to enhance our Market Proxy Prediction Engine (MVP) for career outcomes. · We need hands-on support to boost build quality and speed up delivery. · We seek someone with real experience shipping LLM/RAG systems in production,Experience with vec ...
AI/ML Data Engineer
1 month ago
AI/ML Data Engineer at leading U.S. video-content providers joining core engineering team to support distributed software engineering teams across large-scale infrastructure spanning internal data centers broadcast facilities and public cloud AWS building agentic retrieval workfl ...
Senior Engineer
3 weeks ago
You will join a core engineering team within one of the leading U.S. video-content providers. · CES improvements: PR-level scoring, historical context. · Data/PR tracking: ingest PRs. · ...
Senior Engineer
1 month ago
You will join a core engineering team within one of the leading U.S. video-content providers, supporting hundreds of distributed software engineering teams and operating across a large-scale infrastructure that spans internal data centers, broadcast facilities, and public cloud ( ...
Senior ML Engineer
4 weeks ago
You will join a core engineering team within one of the leading U.S. video‑content providers, supporting hundreds of distributed software engineering teams and operating across a large‑scale infrastructure that spans internal data centers, broadcast facilities, and public cloud ( ...
Senior Engineer
4 weeks ago
The Senior Engineer will join a core engineering team within one of the leading U.S. video‑content providers, supporting hundreds of distributed software engineering teams and operating across a large‑scale infrastructure that spans internal data centers, broadcast facilities, an ...
Senior AI Engineer
2 weeks ago
We are building a serious AI product focused on transforming real-world business conversations into structured intelligence insights and automation. · AI pipelines that analyze recorded conversations speech text structured insights · LLM-based systems for summarization classifi ...
LLM Evaluation and Benchmarking Mentor
1 month ago
+I'm seeking a technical mentor to help deepen my understanding of LLM evaluation and benchmarking, with particular attention to high-stakes applications (e.g., mental health), while developing a generalizable framework for reasoning about model performance across domains. · ...
Voice Agent Prompt Engineer
2 weeks ago
We are hiring an experienced Voice Agent Prompt Engineer to refine and productionize system prompts for a VAPI-based real-time voice agent, · use agent evaluation tools (e.g., Langfuse) to test, score and iteratively improve agent behavior until it meets strict business and conve ...
We are seeking an experienced Principal AI/LLM Platform Architect to design a distributed system for our B2B marketplace. · Designing MVPs and scaling distributed systems. · Implementing tool-calling, RAG, and guardrails for our project. · ...
LLM Prompt Engineering
3 weeks ago
We are building a GenAI-driven recommendation engine that generates structured recommendations by passing user context + prompts to LLMs and evaluating the output. · ...
Fractional CTO AI Strategy
4 weeks ago
You share your experience in Ai development, Ai strategy, scalable Ai production systems to form strategies and accelerate the company's AI roadmap and de-risk decision making. · ...
Artificial Intelligence Engineer
5 days ago
We're looking for a Founding AI Engineer to join us early and help build core product features from the ground up. · ...
Senior AI Agent Systems Engineer
5 days ago
We are hiring a senior engineer to own the design implementation and reliability of a production AI agent that communicates over messaging channels including WhatsApp and iMessage supports multiple languages and triggers real backend actions through tools. · This role is focused ...
Applied AI Intern
1 month ago
Your job will be to make our AI agents smarter, faster and more reliable. You'll iterate on agent behavior, design rigorous evaluation sets and run focused AI research shipping improvements tied to real metrics. · ...
Staff Machine Learning Engineer
1 month ago
We are looking for a Staff Machine Learning Engineer to set the technical direction for ML, LLMs and agents at Boam AI. · ...
Prompt Engineer Needed for AI Model Optimization
1 month ago
We are seeking a skilled Prompt Engineer to enhance the performance of our AI models by designing and refining prompts. · Bachelor's in Computer Science, Data Science, Linguistics or related field (or equivalent experience). · 2+ years hands-on prompt engineering with production ...
Staff Machine Learning Engineer
4 weeks ago
We are looking for a Staff Machine Learning Engineer to set the technical direction for ML, LLMs and agents at Boam AI. · As a Staff Machine Learning Engineer, you will set the technical direction for how ML, LLMs and agents power our platform. · ...
We're seeking a Senior Lead Machine Learning Engineer to architect, ship, and scale the next generation of agentic intelligence across Upwork.You will lead end‑to‑end development of AI agents and the platform that powers them—from LLM training and evaluation to runtime orchestrat ...
Senior LLMOps Engineer
1 month ago
We are building a production GenAI platform with agentic workflows (tool calling) and RAG.We need a senior part-time engineer to implement LLMOps + GenAI analytics and evaluation so we can measure quality at scale, detect and reduce hallucinations, and continuously improve our ag ...