macOSpilot-ai-assistant

Voice + Vision powered AI assistant that answers questions about any application, in context and in audio.

Creative & Media AI & Machine Learning

Explore on GitHub Read Hacker News discussions

2Distinct people

2Mentions

0Explicit recommenders

1.2KGitHub stars

REPOSITORY AT A GLANCE

What to know before exploring

What it is

Voice + Vision powered AI assistant that answers questions about any application, in context and in audio.

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by hour2 dated mentions

Observed mentions: 2023-12-12 13:17:31 UTC to 2023-12-12 16:49:03 UTC.

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges

UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
Period	Start (UTC)	End (exclusive, UTC)	Mentions	Submissions	Comments
Dec 12, 13:00	2023-12-12 13:00:00 UTC	2023-12-12 14:00:00 UTC	1	1	0
Dec 12, 14:00	2023-12-12 14:00:00 UTC	2023-12-12 15:00:00 UTC	0	0	0
Dec 12, 15:00	2023-12-12 15:00:00 UTC	2023-12-12 16:00:00 UTC	0	0	0
Dec 12, 16:00	2023-12-12 16:00:00 UTC	2023-12-12 17:00:00 UTC	1	0	1

What Hacker News says

2 sources

e28eta·Dec 12, 2023

Did you find that calling it “OSX” in the prompt worked better than macOS? Or was that just an early choice that you didn’t spend much time on? I was skimming through the video you posted, and was curious. https://www.youtube.com/watch?v=1IdCWqTZLyA&t=32s code link: https://github.com/elfvingralf/macOSpilot-ai-assistant/blob/...

In Show HN: Open-source macOS AI copilot using vision and voice

ralfelfving·Dec 12, 2023Submission

Show HN: Open-source macOS AI copilot using vision and voice

Heeey! I built a macOS copilot that has been useful to me, so I open sourced it in case others would find it useful too. It's pretty simple: - Use a keyboard shortcut to take a screenshot of your active macOS window and start recording the microphone. - Speak your question, then press the keyboard shortcut again to send your question + screenshot off to OpenAI Vision - The Vision response is presented in-context/overlayed over the active window, and spoken to you as audio. - The app keeps running in the background, only taking a screenshot/listening when activated by keyboard shortcut. It's built with NodeJS/Electron, and uses OpenAI Whisper, Vision and TTS APIs under the hood (BYO API key). There's a simple demo and a longer walk-through in the GH readme https://github.com/elfvingralf/macOSpilot-ai-assistant, and I also posted a differe

Read the rest

nt demo on Twitter: https://twitter.com/ralfelfving/status/1732044723630805212

430 points · Open discussion