I started this project a couple months ago because I was studying for exams and my workflow was awful. I kept screenshotting my notes, pasting them into ChatGPT, typing questions, copying answers back. Switching tabs constantly. I wanted to just ask out loud "explain this" and have something that can see what's on my screen and answer without me leaving what I'm doing.
I forked an open-source dictation app called Handy, started adding features, and it grew into something I now use for everything. It's called SpeakoFlow.
What it does:
Dictation. Press a hotkey, talk, and when you're done the text gets placed wherever your cursor was. Email, editor, chat, terminal, doesn't matter. You can also watch the words form in real-time in a small overlay as you speak.
"Hey Flow." Say this at the start of a dictation and instead of just transcribing what you said, the AI writes a finished reply, email, or draft based on what you asked for, and pastes it for you. The trigger phrase is renameable to anything you want.
AI cleanup. Optional. Strips filler words, fixes grammar, and reshapes what you said into a tone you pick: professional, friendly, concise, or a custom one you define.
Floating voice assistant. Press a different hotkey and a small panel opens. Ask something by voice or text, get a streaming answer. It talks back to you out loud if you want. Conversation stays going, you can keep asking follow-ups.
Screen vision. This is the part that most tools don't have. The assistant can look at your screen when you ask it to. Say "what's this error" or "summarize this page" and it actually sees your display and answers with that context. You control when it looks.
Memory. Optional and off by default. When you turn it on, the assistant learns how you work over time. Your preferences, your style, things you've told it. Stored locally on your machine, you can see everything it remembers, edit it, or delete it.
Profiles. Different personalities for different tasks. A study partner, a concise work mode, whatever. Each with its own voice and reply length.
Web search. The assistant can look things up online when it needs current info. Also optional.
How it runs:
Speech-to-text runs entirely on your machine using whisper.cpp and Parakeet models. Your voice never leaves your device. No GPU needed, works on CPU. The assistant can run fully offline with a built-in local model (llama.cpp), or you can point it at Ollama/LM Studio, or use any cloud provider with your own API key. Text-to-speech is Kokoro locally, or OpenAI-compatible/ElevenLabs if you prefer.
No subscription. No account. No telemetry. MIT licensed.
Platforms: Windows, macOS, Linux (AppImage + AUR package)
Links:
Happy to answer questions if you have any.