How to give Gemini access to your calls
Gemini’s own note-taking lives inside Google Meet. SwitchDesk records any call on your Mac, with no bot in the meeting, and writes the notes when it ends. Add it to Gemini as a custom connected app, and Gemini can answer from all of those calls, on the web and in the Gemini app on your phone.
- No bot in your call
- Recorded on your Mac
- About 5 minutes to set up
What did the Fernhill team ask for on Monday’s call?
Read Fernhill weekly · Oct 13
They asked for the API docs before the pilot, and for weekly check-ins on Thursdays…
Why give Gemini your calls
Gemini already plans your day from your Google account. With your calls connected, it also knows what you promised on them, whatever app the call was in.
What to ask Gemini
“What did the Fernhill team ask for on Monday’s call?”
ReadsFinds the call and answers from its notes.
“Plan my week around what I promised on calls.”
ReadsReads your action items and suggests a plan in the chat.
“Which calls this month talked about the API?”
ReadsSearches your calls’ titles and notes.
“Add a to-do for each thing I promised Joe.”
ChangesAdds them to your SwitchDesk list, or sends them as one card to approve.
Set it up
SwitchDesk on your Mac
Record a call
Install SwitchDesk and record your next call: click Record Meeting in the menu bar, or Record on the countdown pill when the call starts. When it ends, the notes are ready: a summary, action items and the transcript.
SwitchDesk and Gemini
Connect Gemini
On your Mac, open Settings → AI Access → Connect an AI → Gemini and pick how much it may do. In Gemini, open Settings → Connected Apps → Add a custom app, paste
https://mcp.switchdesk.org/mcpand click Next. Sign in with your SwitchDesk email. Full Gemini setup.SwitchDesk on your Mac
Switch on “Share meetings & notes with your AIs”
It’s in Settings → AI Access. Enter the code we email you on “Confirm it’s you”. When SwitchDesk offers to include the past calls on this Mac, say yes to give Gemini your history.
Gemini
Ask about a call
Start with something you can check, like “What did the Fernhill team ask for on Monday’s call?”
Google offers custom connected apps only on personal Google accounts in the US, for people 18 or older. Work and school (Workspace) accounts can’t add one.
Want exact words? Tick “Include full transcripts” in the same place. SwitchDesk warns: “Other people’s exact words.” Then give Gemini Full control, or switch Transcripts on in Fine-tune. Summaries, action items and your own notes don’t need it.
What Gemini can and can’t see
| From your calls | Gemini |
|---|---|
| Summaries and action items | Yes, once you share your calls |
| Your own notes from the call | Yes |
| Search across every shared call | Yes |
| Full transcripts | Only with “Include full transcripts” and Full control |
| The audio | Never |
| Calls marked “Never share this call” | Never |
| Editing or deleting your notes | Never |
Every call Gemini makes shows up in Activity on your Mac. Revoke ends the connection at once.
Which calls work
Any call whose audio plays through your Mac: Google Meet, Zoom, Microsoft Teams, in the browser or the app. SwitchDesk records your voice and theirs on separate tracks, so there’s no bot in the participant list. On Google Meet in Chrome, it also names who said what. How SwitchDesk records calls.
Published . Connect Gemini to your to-do list →