gsxdsmandBohdan Triapitsyn
1ed5316ac7
* feat(voice): add voice input/output support with multiple providers - Add BrowserVoiceButton component for Web Speech API voice input - Add VoiceProvider context for managing voice state across the app - Add TTS (Text-to-Speech) support with browser, macOS Say, and OpenAI providers - Add message TTS buttons to read assistant messages aloud - Add VoiceSettings page in OpenChamber settings - Add server endpoints for TTS and summarization services - Include slider component for voice rate/pitch/volume controls - Add hidden session support for background voice operations - Add Caddyfile for HTTPS support (required for microphone access) * fix: Build errors fixed and removed outdated ElevenLabs test code. * refactor(voice): use zen API with gpt-5-nano for TTS summarization Replace the hidden session + OpenCode SDK approach with direct calls to the opencode.ai zen API (same pattern used for commit message and PR description generation). - Rewrite summarization-service.js to call zen/v1/responses with gpt-5-nano - Remove hidden session logic (hiddenSession.ts, sessionStore filtering) - Remove summarizeModel setting and model selector from VoiceSettings - Simplify client-side summarize.ts to no longer pass model params - Clean up callers in useMessageTTS and useBrowserVoice * fix(voice): remove false 'voice not supported' warning in settings Mobile Safari does support voice but the isSupported check was incorrectly flagging it. Remove the warning banner entirely. * feat(voice): add configurable summary length limit for TTS output Add a slider (50-2000 chars) in voice settings to control max summary length. The limit is passed through the summarize endpoint and speak endpoint to the zen API prompt, with token budget scaled accordingly. * fix(voice): add diagnostic logging and sanitize TTS fallback Add console logging throughout the summarization flow (client + server) to trace why text may not be summarized. Fix silent error swallowing in /api/tts/speak. Always apply sanitizeForTTS even when summarization is disabled so raw markdown/code is never spoken verbatim. * fix(voice): fix token budget starving model of output tokens max_output_tokens includes both reasoning and output tokens. With effort:'low', reasoning alone consumes ~128 tokens, so a budget of 100 left zero tokens for the actual summary text. Use a fixed 1000 token budget (matching commit message generation) and control output length via the prompt's character limit instruction instead. * chore(voice): remove diagnostic logging from summarization flow * fix(voice): don't request mic permission on mobile page load Remove the useEffect that pre-requested microphone permission when the BrowserVoiceButton component mounted on mobile. This caused an unwanted permission prompt immediately on page load before the user tapped the mic icon. Permission is now only requested on explicit user interaction. * fix(voice): remove unused BrowserVoiceButton binding * fix(voice): desktop mic flow + non-continuous draft mode * fix(voice): stabilize continuous loop and polish controls * feat(settings): mark voice section experimental --------- Co-authored-by: Bohdan Triapitsyn <artmore@protonmail.com>
36 lines
1.0 KiB
TypeScript
36 lines
1.0 KiB
TypeScript
/**
|
|
* Static voice context configuration
|
|
* Controls voice behavior and feature flags for the ElevenLabs voice agent
|
|
*/
|
|
export const VOICE_CONFIG = {
|
|
/** Disable all tool call information from being sent to voice context */
|
|
DISABLE_TOOL_CALLS: false,
|
|
|
|
/** Send only tool names and descriptions, exclude arguments */
|
|
LIMITED_TOOL_CALLS: true,
|
|
|
|
/** Disable permission request forwarding */
|
|
DISABLE_PERMISSION_REQUESTS: false,
|
|
|
|
/** Disable session online/offline notifications */
|
|
DISABLE_SESSION_STATUS: true,
|
|
|
|
/** Disable message forwarding */
|
|
DISABLE_MESSAGES: false,
|
|
|
|
/** Disable session focus notifications */
|
|
DISABLE_SESSION_FOCUS: false,
|
|
|
|
/** Disable ready event notifications */
|
|
DISABLE_READY_EVENTS: false,
|
|
|
|
/** Maximum number of messages to include in session history */
|
|
MAX_HISTORY_MESSAGES: 50,
|
|
|
|
/** Enable debug logging for voice context updates */
|
|
ENABLE_DEBUG_LOGGING: true,
|
|
} as const;
|
|
|
|
/** Type for VOICE_CONFIG keys */
|
|
export type VoiceConfigKey = keyof typeof VOICE_CONFIG;
|