Back to all posts中文

What I'm building, and the thread through it

A short tour of the tools I work on outside research: ThunderTalk, Wemute, a skill hub for coding agents, a planner, a finance app and an early agent-team project, and the three ideas they share.

People sometimes ask why I have so many side projects. They look unrelated: a voice app, a file converter, a planner, a finance app, a skill hub for coding agents. They are closer than they look, so here is the list and what connects it.

The tools

ThunderTalk is a voice toolkit for macOS. Press a key, speak, and text appears at the cursor. It also transcribes recordings with speaker labels and reads text aloud in a cloned voice. Everything runs on the Mac through MLX. It is open source and installs with Homebrew.

Wemute is a local file converter for Mac and the browser: images, video, audio, Office, PDF, e-books, OCR and background removal. The part I use most is the command line. wemute extract report.pdf turns almost any file into structured text that a language model can read, and wemute extract call.m4a --speakers does the same for a recording, with speakers labelled. It reuses ThunderTalk for speech.

Rosetta is a shared skill hub and memory layer for Claude Code and Codex. Both agents load the same library of more than 260 curated skills through a small set of routers, and both can recall what earlier sessions learned about my projects. It is private for now. I wrote up what I measured while building it in a separate post.

ASMO · 逐日 is a calendar and to-do list for macOS that a coding agent can use. I tell Claude Code or Codex what my day looks like, and the tasks, routines and dates show up in the app as we talk, along with a Markdown page for each day. It works through a command line and an MCP server, and the app itself runs no model: the agent I already use does the thinking.

Keel is a local-first household finance app for Mac. It imports statements, keeps a double-entry ledger and shows how the month is going. It is not published yet.

Digital Employee is the earliest of these. It is a small control plane for running a team of agents with defined roles, the way a company runs departments. So far it is design documents and one command-line tool.

The thread

Three ideas run through all of them.

  1. It runs on your machine. Speech, documents, finances and plans are the most personal data people have. Small models on Apple Silicon are now good enough that most of this work does not need to leave the laptop.
  2. An agent can use it too. Each tool has a command line or produces plain text, so a coding agent can call it the same way I do. Wemute's extractor exists because agents need files as text, and Rosetta exists because agents need to know which tool to reach for.
  3. A person reviews before anything changes. In ASMO, asmo undo takes back any change an agent made. Keel keeps my own edits and decisions when statements are imported again. In Rosetta, any update that changes a script waits for my review before it is merged. I trust automation more when I can see what it did.

I build these because I use them every day, and using them is how I find out what agents still cannot do well. That feeds back into my research on post-training and agent harnesses.

If any of this overlaps with what you are working on, I am glad to compare notes.