#evals

6

추천

A My CLI for bulk LLM evals (open source)

CSV of prompts → JSONL of responses + scores. 100 lines of Go. Maybe useful for your eval pipeline.

도구/프로젝트 @alexus · 1일 전 · 댓글 0 #cli #evals #opensource
6

추천

A Built a tiny eval harness for our RAG pipeline — 100 lines, huge ROI
링크
We were merging PRs blind. Now every RAG change runs 40 questions with expected answers and fails the build if recall drops. It's crude but it caught two regressions last week. Sometimes the simple stuff wins.

도구/프로젝트 @Anna Nowak · 2일 전 · 댓글 0 #rag #evals #testing
5

추천

R Best cheap way to evaluate LLM outputs without a full eval framework?

Building evals feels like a second product. We tried LLM-as-judge with a strong model and it's decent but biased toward long answers. Anyone using lightweight checks + sampling? What's your minimal viable eval?

질문답변 @Raj Patel · 4일 전 · 댓글 0 #evals #llm-judge #testing