Private AI voice system that lets you change speech providers without rebuilding the whole workflow
AIspeaky is a cross-platform AI voice platform that combines a local speech engine, a desktop interface, backend services for accounts and licensing, and integrations with multiple AI, STT, and TTS providers.
Voice features and AI workflows can leak sensitive user input when provider routing, credentials, and system boundaries are set up poorly. This platform had to support AI voice features while protecting user data and leaving room to change providers later.
The system sends sensitive voice traffic through a protected relay instead of exposing providers directly to the client. The speech pipeline was designed so STT, LLM, or TTS providers can be replaced without rewriting everything. Backend services were defined through clear contracts, and the desktop/cloud split lets latency-sensitive voice processing run locally while licensing, usage tracking, and provider sessions stay under backend control.
The patterns that shaped this system
- 01
Blind Proxy / Privacy Relay
- 02
Provider-agnostic voice pipeline
- 03
Contract-first backend
- 04
Hexagonal / ports-and-adapters architecture
- 05
Hybrid desktop and cloud execution
What the system looks like from the outside
- 5,300+ tracked files
- 2.1M+ lines of text artifacts
- 2,798 Python files
- 1,129 TypeScript/TSX files
- 565 Markdown documents
- 1,493 test files
- 9 backend domains
- 53 OpenAPI operations
- 16 Postgres tables
Designed for sensitive AI voice work: private data handling, easy switching between providers, secure relay services, a split desktop/cloud setup, and clear API contracts for how systems connect.
This case shows how to build an AI voice system that protects sensitive input, keeps provider options open, separates local and cloud responsibilities, and accounts for licensing, operational control, and future growth.
Relevant if you are building an AI product that handles sensitive user input, works with several providers, includes voice features, spans desktop and cloud, or needs strong privacy controls from the start.
- 01Switching AI / STT / TTS providers without rewriting the pipeline
- 02Shipping desktop and cloud increments under one contract surface
- 01Privacy relay that limits what reaches third-party providers
- 02Hexagonal architecture with clear provider and storage interfaces
- 031,493 test files to support confident refactoring
Engagements where this case applies
Sensitive implementation details are omitted from the public version. More detailed technical discussions may be possible during discovery where appropriate.
Discuss a Privacy-First AI System?
Share your situation. I will review it and suggest the most practical next step: an assessment, a discovery call, or a more specific engagement.