Skip to content

Build Faster With Voice

A practical guide for using voice to build tools, patch bugs, write articles and generally get more done

Most people think of speaking into their devices as a faster way of typing.

But that is only a fraction of what’s possible. Paired with AI agents, speech is capable of transforming how you build software, write articles, and tackle your inbox. The combination allows you to record a conversation or talk through a half-formed idea, point an agent to relevant context, and ask for a specific outcome—without first translating everything into polished prose or code.

Today, most digital tasks still start with an act of transformation—you talk to a customer about an unreliable feature and convert the conversation into a bug report. You have an idea on a walk, and hold on to it until you can sit down at your laptop and turn it into an article. We’ve been trained to process and edit context, choosing the pertinent details, cutting out tangents, and imposing a structure before we dive into the work itself.

Filtration and consolidation are no longer requirements. Agents are great at sifting through copious amounts of information to find what matters, and AI notetaking apps allow you to capture context as it naturally occurs—in calls, meetings, or when you’re out in the world.

To name a few examples: An engineer can finish a 19-minute customer call about browser lag, give the transcript to a coding agent, and get a patch in return. A writer can talk through an idea for an essay and refine the outline over several rounds until the structure feels right. An executive can open an email thread, explain the situation and their desired tone, and let an agent write the response.

These are all workflows at Every that reveal how voice is superseding text for many types of knowledge work. This guide will show you how to turn conversations and half-formed thoughts into software, writing, messages, and recurring workflows.

Two ways to work with voice

I think of voice entering a workflow in two main ways:

Active collaboration happens while you are doing the work and know what you want voice to help you accomplish. You talk to an agent while it edits a draft or investigates a bug. Or you dictate an email in Gmail or a message in Slack. This was the original use case around which I built Monologue, Every’s voice dictation app.

Active collaboration can also unfold as a continuous conversation. New voice models such as GPT-Live can listen and speak at the same time, allowing you to interrupt, redirect, and ask follow-up questions. For more complex work, GPT-Live can send a task to another model in the background, continue talking with you, and return with the result when it’s ready.

My colleagues at Every are already working this way: Dan Shipper recently used GPT-Live to write and revise a longform article.

Dictation is useful for when you know what you want to say or where the words should go, whereas live conversation works better when you need to ask questions and make corrections in real time. In both cases, you’re speaking as you work, rather than recording something to use later.

To see this way of working in action, join us for Voice Mode Camp, a one-hour live session where the Every team will demonstrate practical voice workflows for writing and agent orchestration, help you get started, and answer your questions.

Passive capture happens before you know where the words belong. You might record your musings during a walk, a question-and-answer session from an all-hands meeting, or a series of customer calls, and save it all as context to mine later. These recordings can run long and cycle through several different topics or ideas; organizing the content comes later. I designed Monologue Notes, which is available through the Monologue app on Mac, iOS, and watchOS, for this kind of passive capture. Monologue Notes records and transcribes meetings, calls, and rambling thoughts, and saves them in a searchable archive. Later, Codex, Claude, or another agent can retrieve the relevant context and turn it into a draft, plan, decision, or code change.

The agentic voice loop

Throughout my own work and from the examples my colleagues have shared, nearly every useful voice workflow follows the same five steps. With recorded audio, those steps may unfold over hours or days; in a collaborative session, they can overlap and repeat as you talk.

Capture → add context → define the outcome → act → review and redirect

  1. Capture the raw material. Speak while you work, or record a meeting, call, or train of thought. Allow yourself to include tangents and details you would cut from an email. The agent can sift through or organize all of that later.
  2. Add context. When you speak to agents in Codex, Claude Code, or other apps, your words become part of the current work session. For related content you recorded earlier, paste in or upload the transcript, or connect your agent to your notes archive so it can retrieve it directly. The agent may still need access to relevant codebases, open issues, Slack threads, Notion documents, or email chains. Direct it toward the right sources, and have it tell you if it cannot access something. In a live session, it can retrieve this supporting context as the conversation continues.
  3. Define the outcome. First, tell the agent what you want it to create, be it a bug patch, article outline, email draft, go-to-market brief, or website change. Then specify exactly where the output should go—examples include a specific code project, Google Doc, Slack channel, or Linear project.
  4. Act on the task. The agent searches, reads, writes, and runs the necessary tools. If you’re collaborating with it in real time, it can report progress or surface blockers while the conversation continues, and you can interrupt it before it finishes.
  5. Review, redirecting if necessary. Evaluate the agent’s approach to the task: Did it find the right recording, access the right resources, and complete the task? Then check the result. This might include the tests and code changes for a patch, the tone of an email, or the architecture of a go-to-market plan. Correct any faulty assumptions or missing context, and have the agent try again.

In the case of that 19-minute customer call, the full loop would look something like this: Record the call, ask Codex to retrieve the transcript, point the agent toward the appropriate codebase, and ask for a diagnosis of the problem along with a targeted fix. In a live session, you can talk Codex through the issue while it investigates, and correct its assumptions in real time.

Knowing what to say

A spoken brief should usually contain three things: the project you’re working on, where to find additional context, and what you want the agent to produce.

These components are usually enough to tackle even complicated projects. After running a virtual event for Every subscribers, Austin Tedesco uploaded the event transcript and chat history into Codex, told it to review supporting Slack threads and Notion documents, and used Monologue to provide a spoken brief on the follow-up materials he wanted to create—including a companion repository with the event recording and transcript in addition to a follow-up email to attendees.

Steal this spoken brief template:

Template

Here is what’s happening: [situation, observation, or problem].

Retrieve more context from: [notes, transcript, thread, folder, repository, or connected system].

What I want you to generate: [artifact] for [person, tool, or destination].

Constraints: [rules to follow, restrictions on what can be changed, deadlines].

Connect your notes and transcripts to your agent

Connecting your AI note taker to your agent lets you access transcripts by asking it to pull “the customer call from last Tuesday” or “all my notes about onboarding from this month,” and combine them with context from your codebase, Slack, Notion, email, or other connected tools.

This connection makes passive capture practical. You can record something before you know where the information belongs, trusting that your agent will surface content once it becomes relevant.

To connect your AI note taker app to an agent, look for one of these access points:

  • A built-in connector or Model Context Protocol server: Select the app inside your agent and authorize access
  • An API or command-line interface (CLI): Install the app’s tool so the agent can run commands that search and retrieve recordings
  • A synced folder or automatic export: Give the agent access to the folder where transcripts are saved

Whichever route you use, test that the agent can find a recording by date or topic and retrieve the full transcript. (Agents are excellent at mining lots of context for what’s important, and AI-generated summaries can be wrong or miss key details.)

Monologue supports direct agent access through the Monologue toolkit. The toolkit includes a read-only CLI that can list, search, and retrieve notes, summaries, and transcripts. It also includes a monologue-notes skill that teaches Codex, Claude Code, and other terminal-capable agents how to use those commands.

Set up Monologue in Codex or Claude Code

You can ask your agent to handle the installation. Open Codex or Claude Code and paste this prompt:

Prompt

Set up Monologue Notes for me using the official toolkit:

https://github.com/EveryInc/monologue-toolkit

Read the current README. Show me the commands you plan to run, then install the Monologue CLI and the global monologue-notes skill after I approve them.

Do not ask me to paste my Monologue API key into this chat. When authentication is required, pause and tell me how to create a personal API key in the Monologue app and run monologue onboarding myself.

After I confirm that onboarding is complete:

1. Verify the connection with monologue notes list --limit 5.

2. Confirm that the monologue-notes skill is installed.

3. Tell me what you installed and where it lives.

4. Give me one natural-language prompt I can use to test note retrieval.

Do not display, copy, or store my API key in the chat or project files.

When the agent pauses, open Monologue on your Mac and go to Settings → Notes → API. Create a personal API key. Then open Terminal, run monologue onboarding, and paste the key into the terminal prompt. You only need to authenticate once.

After the agent verifies the connection, try:

Prompt

Use the monologue-notes skill to find my most recent note. Give me its title, date, and a one-sentence summary, and identify the note you used.

Once that works, you can access all your recordings by requesting them in natural language and the agent will handle the retrieval.

This guide is for paid subscribers

Upgrade your membership to continue reading the full guide.

Subscribe to continue

A voice workflow library

We use analytics and advertising tools by default. You can update this anytime.