convez.ai
MCP Server
cognis-digital

uncensored-fleet

cognis-digital/uncensored-fleet

Ver no GitHub
BomPluginScore · de 0 a 100

Deploy a local multi-model LLM fleet (llama.cpp) with an agent harness, hermes memory, and a one-command CLI

Instalação

$npx convez-ai cognis-digital/uncensored-fleet

1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.

Métricas

Estrelas
2
Forks
0
Acompanhando
0
Saúde
100%
Último commit
há 4 meses
Versão
—
Issues abertas
1
Contribuidores
2

README

A tradução para o português deste README ainda está na fila.

uncensored-fleet

Deploy a local multi-model LLM fleet in one command — llama.cpp slots, an agent harness, and engram memory.

License: COCL 1.0 Local llama.cpp Suite

Your hardware. Your models. No API keys, no rate limits, nothing leaves the box.

pip install cognis-uncensored-fleet
bash scripts/build-llamacpp.sh     # build the engine (CUDA/Metal/Vulkan auto)
fleet pull all                     # download the model fleet
fleet up uncensored                # start the commander slot
fleet agent "summarize ./notes and propose next steps"

Usage — step by step

  1. Install the fleet command, then build llama.cpp + pull models (setup prints the platform script to run first):
    pip install -e .
    fleet setup
    
  2. List the slots to see each model, its port, VRAM and role:
    fleet models
    
  3. Pull and start a slot (use all for the whole fleet), then check it's serving:
    fleet pull all
    fleet up uncensored
    fleet status
    
  4. Use the fleet — send a one-shot prompt to a slot, or run the agent harness on a task (--slot defaults to uncensored):
    fleet run uncensored "summarize this repo"
    fleet agent "scaffold a fizzbuzz module with tests" --slot coding
    
  5. Tear down when finished (omit the slot to stop all):
    fleet down
    

Contents

Why

Cloud LLMs gate you on price, rate limits, and content policy. uncensored-fleet stands up a fleet of local models — reasoning, math, coding, vision, and an abliterated "commander" — each served by llama.cpp on your own GPU, and gives you a model-agnostic agent harness to drive them. It is the deployment layer for a private, unrestricted, self-improving local AI stack.

The fleet

SlotRoleDefault modelPort
reasoningplanning / analysisDeepSeek-R1-Distill-Qwen-7B8771
mathSymPy-verifiable problemsQwen2.5-Math-7B8772
codingcode gen + editsQwen2.5-Coder-7B8773
visionimage / OCRQwen2-VL-7B8775
uncensoredcommander, unrestrictedJosiefied-Qwen3-8B-abliterated8774

VRAM-aware: conflicting slots auto-evict. Override any slot in fleet.yaml.

Quick start

fleet models                 # list slots
fleet pull all               # download GGUFs (huggingface_hub / hf-cli / direct)
fleet up all                 # start servers (or: fleet up coding)
fleet status                 # see what's live
fleet run coding "write a python LRU cache"
fleet agent "audit ./repo for secrets and write FINDINGS.md" --slot uncensored
fleet down                   # stop everything

The harness

A tiny, dependency-free agent loop (fleet/harness.py) talks to any slot over the llama.cpp OpenAI-compatible endpoint and supports safe tools (run_bash, read_file, write_file) via a simple TOOL:: / FINAL:: text protocol — model-agnostic, so it works with whatever you load.

Engram memory

The harness remembers. It uses the Cognis engram fork for portable, model-agnostic long-term memory when installed (pip install "cognis-uncensored-fleet[engram]"), and falls back to a local SQLite store otherwise. Every task's outcome is recalled on the next related run.

Explore the Cognis Neural Suite

uncensored-fleet is the local-AI backbone of the Cognis Neural Suite (170+ tools). Pair it with:

Responsible use

Local, unrestricted models are powerful. Use them lawfully and ethically; you are responsible for what you generate and run.

How it fits

flowchart LR
  U[You / CI / Agent] --> R[uncensored-fleet]
  R --> O[Outputs & artifacts]
  R --> M[MCP / JSON]
  M --> AI[AI agents]
  R --> S[Cognis Neural Suite]

Explore the suite → 🗂️ all tools · ⭐ awesome-cognis · 🔗 cognis-sources

Interoperability

uncensored-fleet composes with the 300+ tool Cognis suite — JSON in/out and a shared OpenAI-compatible /v1 backbone. See INTEROP.md for the suite map, composition patterns, and reference stacks.

Integrations

Forward uncensored-fleet's findings to STIX/MISP/Sigma/Splunk/Elastic/Slack/webhooks via cognis-connect. See INTEGRATIONS.md.

License

Source-available under the Cognis Open Collaboration License (COCL) v1.0 — see LICENSE. Commercial use: licensing@cognis.digital.


Ver o original no GitHub

Bom para

Relacionados