Devtools
Prompt Regression Tests
Catch quality drops when prompts or models change
Intermediate14h1–2
Node.jsLLMGitHub Actions
17/20Visual Regression Bot
Screenshot key pages on each PR and highlight visual changes.
Intermediate16h1–2 people17/20 fit
Build Visual Regression Bot for frontend teams in ~16h with 1–2 people. Stack: Playwright + GitHub Actions + Node.js.
Why it wins: Visible output and real value.
Build flow
01 · Problem
CSS changes break pages nobody checked.
02 · Solution
Capture screenshots with Playwright, diff against the main branch and post highlighted changes on the PR for approval.
03 · Build
- 1Capture screenshots
- 2Diff images
- 3Upload results
- 4Comment
04 · Demo
Change a margin and see the highlighted diff.
MVP checklist
- Page list
- Pixel diff
- PR comment
- Approve baseline
Tech stack
| Tech | Role | |
|---|---|---|
| Playwright | Browser automation | Tool |
| GitHub Actions | Repo + PR data | API |
| Node.js | Backend runtime | Backend |
Reference repos
Open-source projects you can build on. Links checked 2026-10-31.
Related ideas
More DevtoolsDevtools
OpenAPI Breaking Change Detector
Detect breaking API changes in pull requests before clients break
Intermediate14h1–2OpenAPINode.jsGitHub Actions17/20Flag migrations that will lock tables or lose data before they run
Intermediate14h1–2Node.jsPostgresGitHub Actions17/20