mise

The agentic kitchen copilot

Mise watches your stove through any camera, remembers what you cook, and cuts the power if you walk away. Runs on your laptop. Your kitchen, your data.

Claude Sonnet 4.6 + Opus 4.7

FastAPI + Next.js

runs offline

Sees your stove

Your phone or laptop camera streams frames to a vision-language model. Mise knows the difference between steam, smoke, and oil shimmer.

Plans with you

Ask "I have chicken, rice, soy sauce — walk me through it." Opus 4.7 designs a step-by-step plan; Sonnet 4.6 coaches you through it in real time.

Keeps you safe

If the pan is smoking and you left the kitchen, Mise cuts power to the burner via a smart plug — and texts you while it's doing it.

Remembers

Every cook session is logged. Ask "have I made this before?" or "how did it go last time?" and Mise answers from actual history.

Works on your phone

Prop your phone on the counter, open the site. Uses the phone's camera, mic, and speaker. No app install.

No cloud lock-in

All perception stays on your LAN. Only text observations + pan images go to Claude. Your own OpenRouter key.

How it works

A dimos-style module graph: typed streams carry perception into the agent, the agent routes tool calls to skills, skills actuate the real world.

Perception

Phone / webcam + mic stream frames and speech to the backend every few seconds.

Reasoning

Sonnet 4.6 fuses vision, audio, and plan state — decides whether to act, speak, or stay silent.

Planning (on demand)

Ask for a recipe → Sonnet calls Opus 4.7, gets a structured cook plan, installs it as state.

Actuation

Skills fire: set_burner_percent, kill_power, speak, text_user, advance_step, recall.

What you need to buy

Mise is software-complete without hardware — you can run the full simulator today. To point it at a real stove you need exactly one thing (and optionally one more).

required

Shelly Plus Plug US

Smart plug with a local HTTP REST API, live power monitoring, 15A / 1800W. No cloud round-trip. Mise drives it via Gen2 RPC.

$22.99at Home Depot

optional

Amazon Basics 1800W induction burner

Only if you don't already have an electric cooktop. Any electric kettle, hot plate, or toaster works for the first demo.

~$50amazon

Induction requires magnetic cookware (cast iron, magnetic stainless). If your pans don't stick to a fridge magnet, use a resistive hot plate instead.

Minimum viable spend

$23 — the Shelly plug + any electric appliance you already own. Use a kettle for the first demo; it boils in two minutes at 1500W and proves the whole safety loop.

Quick start

Runs on any laptop with Python 3.11+ and a webcam. No hardware required to try it.

1. Install

Clone and install the Python package in a venv.

git clone https://github.com/0xbl33p/mise
cd mise
python -m venv .venv && source .venv/Scripts/activate
pip install -e .

2. Set your OpenRouter key

Mise routes Claude calls through OpenRouter.

echo "OPENROUTER_API_KEY=sk-or-..." > .env

Grab a key at openrouter.ai/keys. You pay per token; Sonnet is <$0.01 per minute of cooking.

3. Try the simulator

No hardware needed. Synthetic stove, full agent loop.

mise run sim --agent claude --images --duration 60

4. Serve the phone UI

Open https://<your-lan-ip>:8080 on your phone.

mise serve --https --host 0.0.0.0 --plug-ip 192.168.1.XX

Drop --plug-ip to run without hardware. Phone will warn about the self-signed cert once — tap Advanced → Proceed.