Multi-Tier Model Gateway Substrate
Architected unified Model Gateway with multi-tier routing (Luna, Terra, Sol), upgraded Voice Activity Detection for instant 1.2s transcription turnaround, added Whisper phonetic biasing, native Apple Reminders and Notes adapters, and dynamic multimodal vision decoupling.
Architected model-agnostic gateway separating logical tiers (Luna for conversational speed, Terra for balanced OS automation, Sol for frontier coding and reasoning) with prompt caching cost optimization and zero-latency failover.
Ultra-Fast Voice Activity Detection (VAD)
Calibrated trailing silence tolerance to 1.2s with a 400ms speech threshold, eliminating dead-air pauses and initiating instantaneous transcription the moment speech concludes.
Whisper Phonetic Normalization & Vocabulary Biasing
Implemented phonetic correction dictionary and macOS vocabulary prompt biasing for Whisper, eliminating transcription hallucination and phonetic confusion across all voice interactions.
Native Apple Reminders & Notes Handlers
Integrated native AppleScript adapters for creating scheduled reminders with dynamic relative date resolution and formatted Apple Notes directly from voice or text.
Dynamic Multimodal Vision Decoupling
Decoupled display screenshot attachments so conversational queries remain purely lightweight text, attaching high-res screenshots strictly when visual screen analysis is requested.
Retina Native Resolution Screen Coordinates
Upgraded screen capture to compute native display dimensions with Retina scale factors, ensuring pixel-perfect Ghost Cursor, spotlighting, and visual element circling.

