Skip to content

ML Experiment Runner Agent

An agent proposes, runs and compares model experiments on your dataset.

Advanced30h1–3 people15/20 fit
TL;DR

Build ML Experiment Runner Agent for kaggle competitors and ml students in ~30h with 1–3 people. Stack: Python + LLM + DuckDB + Charts.

Why it wins: Turns AutoML into a transparent, explainable agent.

Build flow

01 · Problem
Trying many models and features by hand is slow and poorly tracked.
02 · Solution
The agent profiles the data, proposes experiments, runs them in a sandbox, logs metrics and explains what worked.
03 · Build
  1. 1Profile the dataset
  2. 2Generate experiment configs
  3. 3Run training jobs
  4. 4Summarise results
04 · Demo
Run five experiments on a public dataset and show the leaderboard the agent built.

MVP checklist

  • Experiment proposals
  • Sandboxed runs
  • Metric leaderboard
  • Explanations

Tech stack

TechRole
PythonBackend / scripting
LLMLanguage model
DuckDBIn-process analytics SQL
ChartsData visualisation

Related ideas

More AI Agents