#evaluation hackathon ideas

3 ideas across 3 categories · 0 beginner · 2 intermediate · 1 advanced. Sorted by judging fit (editorial estimate).

Filter these in search

AI
Blind Model Arena for Your Prompt
Compare several models' answers to your own prompt without seeing which is which
Intermediate12h1–2
Vercel AI SDKNext.jsSQLite
17/20
Devtools
Prompt Regression Tests
Catch quality drops when prompts or models change
Intermediate14h1–2
Node.jsLLMGitHub Actions
17/20
AI Agents
Agent Trajectory Evaluator
Replay agent runs, score each step and find where agents go off the rails
Advanced26h1–3
OpenTelemetryLLMNext.js
15/20

Related tags