AU-37: Migrate MacOS Realtime Transcription to Convex Backend (Backend Changes Only)

[apokhrel7]

These changes were made so that Mac App can use the same backend services as web and mobile app. See #34 and psycho-baller/audora-macos#8

Migrate MacOS Realtime Transcription to Convex Backend

Summary

Integrates the macOS app with the shared Convex backend for cross-platform data access, centralized AI processing, and conversation storage. Users no longer need to provide their own OpenAI API keys, all transcription and AI features are now powered through Convex backend with Clerk authentication.

Major Fix: Solved Swift type system limitation with JSON string serialization to enable Mac/Web data sync.

Changes

Backend Integration

• Clerk authentication integrated into ConvexService with ConvexClientWithAuth
• Conversation management: Backend creates conversation records on recording start
• Transcript processing: Sends transcript to backend after recording stops
  • GPT-4o extracts facts and updates Zep knowledge graph
  • Backend parses JSON string if provided (Mac), otherwise uses array (Web)
  • Maintains backward compatibility with web app

Future Considerations

• Offline mode recovery: Add retry logic and offline queueing for failed backend calls and sync when connection restored
• ConvexMobile SDK: Remove JSON string workaround if ConvexMobile SDK improves nested type support
• Cache conversation IDs to avoid redundant lookups (Mac App)

[linear]

AU-37 migrate our macOS realtime transcription to our convex backend

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
linkmaxxing	Ready	Preview, Comment	Feb 6, 2026 1:38am