Snap a messy whiteboard and get tidy Markdown notes with action items
#multimodal hackathon ideas
27 ideas across 7 categories · 10 beginner · 12 intermediate · 5 advanced. Sorted by judging fit (editorial estimate).
Ideas tagged multimodal
- Beginner8h1–2Vision LLMMarkdownNext.js17/20
Snap a product and get a title, description, tags and price range ready to list
Beginner8h1–2Vision LLMNext.jsTailwind17/20Photograph a chart and get the key takeaway plus anything misleading about it
Beginner8h1–2Vision LLMNext.js17/20Climate
Electricity Bill Explainer
Photograph your power bill and understand every charge and how to cut it
Beginner8h1–2Vision LLMNext.jsCharts17/20Checks a food label photo against your allergy list
Intermediate24h1–2ReactVision LLMOCR17/20Photograph a meal and get an editable estimate of calories and macros
Intermediate14h1–2Vision LLMNext.jsNutrition API17/20Finds the exact step where a handwritten solution went wrong
Advanced36h2–3PythonVision LLMSymPy17/20EdTech
Equation Photo to LaTeX
Snap an equation and get editable LaTeX
Intermediate12h1Vision LLMKaTeXNext.js17/20Explain a homework method so parents can help without confusing kids
Beginner10h1Vision LLMNext.js17/20Point the camera at a diagram and hear each part explained
Intermediate12h1Vision LLMNext.js17/20Social Good
Audio Description for Videos
Add spoken descriptions of on-screen action to videos
Advanced24h2–3Vision LLMFFmpegTTS17/20Social Good
Image to Tactile Graphic Converter
Convert diagrams into simplified tactile graphics ready for embossing
Advanced24h2–3PythonOpenCVVision LLM17/20Social Good
NGO Paper Register Digitizer
Photograph paper registers and get a clean spreadsheet
Intermediate14h1–2Vision LLMNext.jsCSV17/20Gaming
AI Guesses Your Drawing
Draw something and race to make the AI guess it
Beginner10h1–2Transformers.jsCanvasNext.js17/20Turns a photo of your fridge into recipes you can cook tonight
Beginner12h1–2Next.jsVision LLMTailwind16/20Jumps to the exact second in a long video where something was said or shown
Advanced48h2–4PythonWhisperVector DB16/20Paste a UI screenshot and get an editable React + Tailwind component
Intermediate18h1–2Vision LLMReactTailwind16/20Snap a foreign-language menu and get dishes translated with veg, allergy and spice flags
Beginner10h1–2Vision LLMNext.jsLocal storage16/20Turn a folder of trip photos into a captioned day-by-day travel story
Beginner10h1–2Vision LLMLeafletNext.js16/20Climate
Home Energy Audit by Photo
Photograph your appliances and get the biggest energy-saving fixes ranked
Intermediate16h1–2Vision LLMNext.jsCharts16/20Social Good
Alt-Text Generator for Websites
Writes missing alt text so blind users can understand images
Beginner12h1–2Next.jsVision LLM16/20Social Good
Civic Issue Reporter
Reports potholes and broken lights with photo and location
Intermediate24h2–3Next.jsVision LLMLeaflet16/20Photograph your clothes once and get weather-aware outfit ideas daily
Intermediate18h1–3Vision LLMWeather APINext.js15/20Turn rough stick-figure sketches and a script into a polished storyboard
Intermediate16h1–3Image generationtldrawLLM15/20Climate
Cafeteria Food Waste Tracker
Shows which dishes get thrown away so kitchens cook less waste
Intermediate36h2–3Next.jsVision LLMCharts15/20Fintech
Payslip Explainer
Explains every line on a payslip in plain language
Intermediate24h1–2Next.jsVision LLMCharts15/20Photograph your room and check whether a sofa or desk will actually fit
Advanced30h2–4Vision LLMthree.jsNext.js13/20