Skip to content
Devtools

Docs Drift Detector

Find docs that no longer match the code.

Intermediate14h1–2 people17/20 fit
TL;DR

Build Docs Drift Detector for open source maintainers in ~14h with 1–2 people. Stack: Tree-sitter + LLM + GitHub Actions.

Why it wins: Useful for every project.

Build flow

01 · Problem
Documentation goes stale after every refactor.
02 · Solution
Compare function signatures and CLI flags in code with documentation snippets and flag mismatches with suggested updates.
03 · Build
  1. 1Extract APIs
  2. 2Parse docs
  3. 3Compare
  4. 4Report
04 · Demo
Rename a parameter and show the outdated doc flagged.

MVP checklist

  • Signature extraction
  • Doc matching
  • Mismatch report
  • Suggested edits

Tech stack

TechRole
Tree-sitterCode parsing
LLMLanguage model
GitHub ActionsRepo + PR data

Reference repos

Open-source projects you can build on. Links checked 2026-10-31.

Related ideas

More Devtools

  • Devtools

    Guided Code Tours

    Record step-by-step tours through a codebase that newcomers can follow

    Intermediate14h1–2
    Tree-sitterLLMNext.js
    17/20

  • Devtools

    Prompt Regression Tests

    Catch quality drops when prompts or models change

    Intermediate14h1–2
    Node.jsLLMGitHub Actions
    17/20

  • Devtools

    Repo README Generator

    Writes a solid README from the repo’s code

    Beginner12h1–2
    Node.jsLLMMarkdown
    14/20