Product updates
Voice chat in Halo: talk to any AI model, hands-free on iPhone
You can now talk to Halo. Tap the mic and have a conversation: it hears you as you speak, answers out loud, and stops the moment you cut in. It works with any AI model you already use in Halo, and the listening and the voice both run on your iPhone.
Most AI voice modes are tied to one company’s speech-to-speech model. I wanted a voice mode that works with whichever model you pick, keeps your voice on your phone, and fits in with everything else Halo already does, like its cards, tools and memory. So I built it from on-device pieces around the chat you already have.
What you get
- Works with any AI provider. No dedicated speech-to-speech service needed.
- Interrupt any time. Talk over a reply and Halo stops and listens.
- On-device ears and voice. Speech recognition and the spoken voice both run on your iPhone.
- Live transcription. You see your words appear as you say them.
- Dynamic UI. Weather, stocks and other answers still come with their cards.
- Action Button and Siri. Ask Halo by voice without opening the app.
Speech to speech with any model
Voice chat has three stages. Only the middle one leaves your phone, and it is the same request a typed message would send.
- 01 · ListenOn device
Apple's speech recognition writes your words live as you talk.
- 02 · ThinkYour model
The finished turn goes to any model you use with Halo, as text.
- 03 · SpeakOn device
Phonon reads the reply aloud, sentence by sentence, as it streams in.
Because the model only ever sees text, voice chat works with Claude, GPT, Gemini, a model you host with Ollama, or anything else you have connected. Each spoken turn is an ordinary chat turn, with the same tools, skills, memory and connected apps. When you are done, the conversation is in your chat history like any other.
Halo doesn’t wait for the whole reply before speaking. As soon as the first sentence has arrived, it starts reading, and the rest follows while the model is still writing. The word being read is highlighted in the chat. Code blocks and tables are skipped, since nobody wants to hear those read out.
Talk over it, any time
Real conversations get interrupted, so Halo lets you cut in. Start talking while it is reading and it stops mid-word, goes back to listening, and takes your new question. The full reply stays in the chat if you want to read the rest later.
The tricky part is that the phone hears its own voice. Halo plays and listens through one audio engine with echo cancellation, so most of the reply never reaches the microphone. What does leak through is the reply’s own words, so Halo only treats words it isn’t saying as you cutting in. A reply never interrupts itself.
You don’t have to wait for it to start talking either. If you think of something while Halo is still working on an answer, just say it, and it goes in as a follow-up.
Listening on your iPhone
Speech recognition uses Apple’s on-device speech framework, so your voice is turned into text on the phone and the audio never leaves it. Your words appear live in the composer under a Listening, Thinking or Speaking line, with Halo’s golden orb beside them. The orb follows your voice: quiet keeps it calm, and a loud word makes it swell.
Halo sends your turn about a second after you stop talking, once the recogniser has settled on what you said. A minute of silence ends the session on its own, so a forgotten voice chat never keeps the microphone on.
A voice that runs on device
Replies are read by Phonon, an on-device neural voice model from Gradium. It speaks English, French, German, Spanish and Portuguese, and each message is read in a voice of its own language, with its accent. You can choose a voice for each language in Settings, under Speech, and play a sample before you pick. For any other language, Halo falls back to Apple’s system voices.
The first time you use it, the model takes a few seconds to load. After that it stays ready while you talk and is released when you are done, so it doesn’t hold on to memory in the background.
Answers you can see
Halo’s answers often come with a card, like the weather for the weekend or a stock’s price chart. Voice chat keeps those. Halo reads the answer to you while the card builds in the chat, so you can listen and glance at the details at the same time.
Ask from the Action Button
I also wanted the best voice assistant experience a third-party app can have on iPhone. Set the Action Button to Ask Halo by Voice and press it from anywhere, even the Lock Screen. A Live Activity shows Halo listening, then thinking, then speaking. The answer is read aloud and shown as a visual card, generated in the background, and the whole thing happens without opening the app.
It is the same agent as in the app, with the same model, tools and memory. Ask a follow-up within ten minutes and it continues the same conversation, and if Halo needs something from you, it asks right in the card. You can also start it from Siri or the Shortcuts app.
Try it
Voice chat is available in Halo now. Tap the mic in any chat to start, or set the Action Button to Ask Halo by Voice in Settings. If you would rather record a conversation than have one, take a look at voice notes in Halo.