Nixi.EXE
Kaliguri/Nixi.EXE
Home voice assistant on cloud LLMs (Claude/GPT/Gemini): local STT/TTS, wake word, skills, FastAPI+React web panel.
Instalação
npx convez-ai Kaliguri/Nixi.EXE1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.
Métricas
README
A tradução para o português deste README ainda está na fila.
Nixi.EXE — Home AI Assistant
A home voice assistant powered by cloud LLMs — say “Nixi”, speak, get a spoken answer. Switch between Claude, GPT and Gemini by voice.
| Core | |
| LLM providers | |
| Speech | |
| Web panel — front | |
| Web panel — back | |
| Desktop / packaging | |
| Patterns |
Web control panel
🖼 Coming soon — control panel screenshots (devices, VU-meters, live dialog, settings tabs).
English
[↑ Back to top]
Nixi.EXE is a home voice assistant for Windows that behaves like a smart speaker but thinks with cloud LLMs. Say the wake word “Nixi”, speak a command, and get a spoken reply — with the model of your choice (Claude, GPT or Gemini), switchable by voice mid-conversation. Speech recognition runs locally on faster-whisper (GPU with CPU fallback), the reply is voiced through a neural Russian voice, and a two-tier router answers simple commands instantly via local skills without ever calling the network. A browser control panel gives you devices, live VU-meters, the running dialog and all settings.
What this project demonstrates: a custom Python orchestrator (not Home Assistant) with local STT/TTS, a state-machine engine driving a background voice loop, real-time UI over WebSocket, a full-stack React + FastAPI panel in Feature-Sliced Design, and a standalone PyInstaller build for distribution without a Python install.
Key features
| Feature | Description |
|---|---|
| Multi-LLM, voice-switchable | Claude, GPT and Gemini side by side. Say “Claude, …” / “GPT, …” to address or switch models on the fly; each model and its triggers are configurable. |
| Wake word activation | Always-on listening for the name “Nixi” via an offline Vosk spotter with fuzzy matching, plus a voice-calibration tool. Push-to-talk is an alternative. |
| Two end-of-command modes | Finish a command by an end phrase (e.g. “go ahead”, default) for long dictation, or by a silence pause — switchable in settings. |
| Local + cloud routing | A two-tier router resolves quick commands (music, time/date) through local skills instantly; everything else goes to the LLM with short conversation memory. |
| Local speech I/O | faster-whisper STT on CUDA with a CPU/int8 fallback; neural edge-tts Russian voice with an offline pyttsx3 fallback. |
| Browser control panel | FastAPI + React panel: input/output device pickers, gain, live VU-meters, start/stop/pause, status, live dialog log, settings tabs and masked API keys — all on localhost. |
| Tray app & standalone .exe | Windows tray icon to run the panel and manage the server (+ autostart), and a CPU-only PyInstaller build that ships without Python. |
Русский
[↑ Наверх]
Домашний голосовой ассистент на облачных LLM — скажи «Никси», говори, получай голосовой ответ. Переключай Claude, GPT и Gemini голосом.
Nixi.EXE — домашний голосовой ассистент для Windows: ведёт себя как умная колонка, но думает облачными LLM. Скажи фразу активации «Никси», произнеси команду — и получи голосовой ответ от выбранной модели (Claude, GPT или Gemini), переключаемой голосом прямо посреди диалога. Распознавание речи (STT) работает локально на faster-whisper (GPU с фолбэком на CPU), ответ озвучивается русским нейро-голосом, а двухуровневый роутер (router) отвечает на простые команды мгновенно через локальные скиллы, не обращаясь в сеть. Веб-панель в браузере даёт устройства, живые VU-метры, лог диалога и все настройки.
Что демонстрирует проект: кастомный Python-оркестратор (не Home Assistant) с локальными STT/TTS, движок-конечный автомат (state machine) для фонового голосового цикла, real-time UI поверх WebSocket, full-stack панель React + FastAPI в архитектуре Feature-Sliced Design и сборку standalone-
.exe(PyInstaller) для раздачи без установленного Python.
Ключевые возможности
| Возможность | Описание |
|---|---|
| Несколько LLM, переключение голосом | Claude, GPT и Gemini рядом. Скажи «Клод, …» / «ГПТ, …», чтобы адресовать запрос или переключить модель на лету; модели и их триггеры настраиваются. |
| Активация по фразе (wake word) | Постоянное прослушивание имени «Никси» через офлайн-споттер Vosk с нечётким совпадением + калибровка под голос. Альтернатива — push-to-talk. |
| Два режима конца команды | Завершай команду фразой конца (например «выполняй», по умолчанию) — удобно для длинных команд — или паузой (тишиной); переключается в настройках. |
| Локально + облако (роутинг) | Двухуровневый роутер решает быстрые команды (музыка, время/дата) локальными скиллами мгновенно; остальное уходит в LLM с короткой памятью диалога. |
| Локальные речь-ввод/вывод | STT faster-whisper на CUDA с фолбэком на CPU/int8; нейро-голос edge-tts (рус.) с офлайн-фолбэком pyttsx3. |
| Веб-панель в браузере | Панель FastAPI + React: выбор устройств ввода/вывода, громкость, живые VU-метры, старт/стоп/пауза, статус, лог диалога, вкладки настроек и маскированные API-ключи — всё на localhost. |
| Трей-приложение и standalone .exe | Иконка в трее Windows для запуска панели и управления сервером (+ автозапуск) и CPU-сборка PyInstaller, которая работает без Python. |
How it works
voice ──▶ record (VAD / end phrase) ──▶ STT (faster-whisper, GPU) ──▶ Router
│
┌── local skill? ──── yes ─────────────────┤ ("play music", "what time is it")
│ │
└── no ──▶ LLM (Claude / GPT / Gemini) ──────┘
│
reply ──▶ TTS ──▶ speaker
Two-tier processing like Home Assistant: simple commands are handled by skills instantly; everything else goes to an LLM. The AssistantEngine runs this loop in a background thread as a state machine (stopped | loading | listening | recording | thinking | speaking | paused | error) and emits events (status, audio levels, transcript, errors) consumed by both the web panel (over WebSocket) and the CLI.
Local development
# 1. Install (creates .venv, installs deps, creates .env)
.\setup.ps1 # core + voice stack
# .\setup.ps1 -GPU # + CUDA-accelerated recognition (~1GB, needs NVIDIA)
# .\setup.ps1 -CoreOnly # core only (no voice)
# 2. Download voice models
.\.venv\Scripts\python.exe download_model.py # command recognition (faster-whisper, ~484MB)
.\.venv\Scripts\python.exe download_wake_model.py # wake phrase (Vosk, ~45MB)
# 3. Put your keys in .env
# ANTHROPIC_API_KEY=... OPENAI_API_KEY=... GEMINI_API_KEY=...
# 4. Run
.\run.ps1 # text mode (console chat)
.\run.ps1 -voice # voice mode (mic + speaker)
.\run.ps1 -ui # web control panel (http://127.0.0.1:8000)
Web panel (frontend):
# Prod: build the front and serve a single process on :8000
cd apps/web; npm install; npm run build; cd ../..
.\run.ps1 -ui
# Dev: backend + Vite dev server with HMR (two terminals)
.\run.ps1 -ui # backend on :8000
cd apps/web; npm run dev # front on :5173 (proxies /api and /ws to :8000)
The frontend uses Feature-Sliced Design (app / pages / widgets / features / shared), TanStack Query for server state, Zod schemas mirrored by Pydantic models on the backend, and react-i18next (EN/RU). Settings are saved to config.yaml (comments preserved via ruamel), keys live in .env (returned to the browser masked only). The server binds 127.0.0.1 — local only.
Configuration
Everything lives in config.yaml: assistant name and default model, per-provider model + triggers, STT (Whisper model, cuda/cpu), TTS, trigger mode (wakeword / push_to_talk), end-of-command mode (phrase / silence) and end phrases, wake phrases and audio devices. Without -GPU, set stt.device: cpu and compute_type: int8.
Project layout
config.yaml config
.env API keys (not in git)
setup.ps1 / run.ps1 install & run
src/
main.py entry point, text/voice loops (on top of engine)
config.py load/save config and .env
llm.py Claude/GPT/Gemini agents + Router
skills.py local skills
voice.py recording, STT, TTS, triggers, end-of-command
audio.py devices, gain, levels (VU)
engine.py managed engine (thread + events) for UI and CLI
tray.py Windows tray icon
server/ FastAPI: REST + WebSocket (app, api, events, schemas)
apps/web/ web panel (Vite/React/TS/Tailwind, Feature-Sliced Design)
Build a standalone .exe
A CPU-only PyInstaller build ships without a Python install — see DISTRIBUTION.md. build-exe.ps1 + assistant.spec produce the binary in a clean CPU .venv-build; self-check via --selftest.
License
© 2026 Kaliguri. All rights reserved.
This repository is public for portfolio and demonstration purposes only. No license is granted to use, copy, modify, or distribute any part of it without prior written permission from the author.
See LICENSE.md for details.