WebRTC LLM Proxy
A WebRTC proxy for different LLMs to expose audio and video interfaces suitable for real non-ideal internet connections, that is not possible with the official WebSocket interface.
For now it is available as a simple service that you can deploy in your own infrastructure and it is suitable for testing and exprerimentation but in the future it could be available as a full docker image or even a hosted service.
Additional interface for LLMs
Exposes LLMs models AI capabilities through WebRTC.
Suitable for Real Network Conditions
Unlike the official WebSocket interface, this is designed to handle non-ideal internet connections, ensuring a stable experience.
Real-time Communication
Utilizes WebRTC for low-latency, real-time audio and video streaming between clients.
Disabled demo access temporarily due to high cost
Voice Agent Demo
git clone https://github.com/livetok-ai/live-proxy
pip install -r requirements.txt
GOOGLE_API_KEY=XXX python proxy.py