Compare several models' answers to your own prompt without seeing which is which
Intermediate12h1–2
Vercel AI SDKNext.jsSQLite
17/20#devtools hackathon ideas
10 ideas across 4 categories · 0 beginner · 6 intermediate · 4 advanced. Sorted by judging fit (editorial estimate).
Ideas tagged devtools
AI Agents
Agent Run Budget Guard
Stop runaway agents by capping tokens, cost and steps per task
Intermediate12h1–2Node.jsVercel AI SDKSQLite17/20Climate
Carbon-Aware CI Scheduler
Delay non-urgent CI jobs to cleaner grid hours automatically
Intermediate14h1–2GitHub APIElectricity Maps APINode.js17/20AI Agents
Code Review Agent
Catches risky changes before a human reviewer looks at the PR
Intermediate36h2–3PythonGitHub APILLM16/20AI Agents
Accessibility Fix PR Agent
An agent finds accessibility issues and opens a PR that fixes them
Advanced26h1–3axe-corePlaywrightLLM16/20Productivity
Web Accessibility Checker
Finds accessibility issues before users do
Intermediate24h1–3Next.jsAxe-corePuppeteer16/20AI Agents
Agent Trajectory Evaluator
Replay agent runs, score each step and find where agents go off the rails
Advanced26h1–3OpenTelemetryLLMNext.js15/20AI Agents
Dependency Upgrade Agent
An agent upgrades a dependency, fixes breaking changes and opens a PR with test results
Advanced28h1–3LLMGitHub APINode.js15/20AI Agents
Agent Memory Viewer and Editor
See, search, correct and delete what your agent remembers about a user
Intermediate16h1–2Vector DBLLMNext.js15/20AI Agents
Bug Report to Repro Script Agent
Paste a vague bug report and the agent tries to reproduce it as a Playwright test
Advanced30h2–3PlaywrightLLMLangGraph14/20