convez.ai
MCP ServerDevOps & InfraestruturaIntermediário
cognis-digital

Flakefinder

cognis-digital/flakefinder

Detecta e prioriza testes instáveis do histórico de CI em segundos

Ver no GitHub
BomPluginScore · de 0 a 100

Detector de testes instáveis (flaky tests) que analisa histórico de CI e sugere quarentena de testes problemáticos. Ferramenta self-hostable via MCP server, pronta para automação em pipelines de CI/CD e integração com agentes de IA.

Instalação

$npx convez-ai cognis-digital/flakefinder

1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.

Métricas

Estrelas
0
Forks
0
Acompanhando
0
Saúde
100%
Último commit
há 4 meses
Versão
—
Issues abertas
0
Contribuidores
1

Casos de uso

  • Identificar e isolar testes flaky em suites de teste grandes
  • Automatizar detecção de testes instáveis em pipelines CI/CD
  • Priorizar correção de testes problemáticos por risco
  • Integrar análise de flakiness em workflows de agentes de IA

Veredito

Ferramenta focada e prática para um problema real em CI/CD. Polyglot, self-hostable e com suporte nativo a MCP torna-a valiosa para times que precisam automatizar detecção de testes flaky sem dependências externas.

README

A tradução para o português deste README ainda está na fila.

FLAKEFINDER

Flaky-test detector from CI history with quarantine suggestions

PyPI CI License: COCL 1.0 Suite

Developer Tools — fast, single-purpose, CI- and agent-friendly.

pip install cognis-flakefinder
flakefinder scan .            # → prioritized findings in seconds

Contents

Why flakefinder?

universal test pain

flakefinder is single-purpose, scriptable, and self-hostable: point it at a target, get prioritized results in the format your workflow already speaks (table · JSON · SARIF), gate CI on it, and let agents drive it over MCP.

Features

  • ✅ Load Runs
  • ✅ Flakiness Score
  • ✅ Analyze
  • ✅ Runs on Linux/macOS/Windows · Docker · devcontainer
  • ✅ Ports in Python, JavaScript, Go, and Rust (ports/)

Quick start

pip install cognis-flakefinder
flakefinder --version
flakefinder scan .                       # scan current project
flakefinder scan . --format json         # machine-readable
flakefinder scan . --fail-on high        # CI gate (non-zero exit)

Example

$ flakefinder scan .
  [HIGH    ] FLA-001  example finding             (./src/app.py)
  [MEDIUM  ] FLA-002  another signal              (./config.yaml)

  2 findings · risk score 5 · 38ms

Architecture

flowchart LR
  A[Input: file / dir / API] --> B[Collectors]
  B --> C[Rules / Analyzers]
  C --> D[Scorer]
  D --> E{Reporters}
  E --> F[Table]
  E --> G[JSON / SARIF]
  E --> H[MCP tool -. drives .-> AI agents]

Use it from any AI stack

flakefinder is interoperable with every popular way of using AI:

  • MCP server — flakefinder mcp (Claude Desktop, Cursor, Cognis.Studio, uncensored-fleet)
  • OpenAI-compatible / JSON — pipe flakefinder scan . --format json into any agent or LLM
  • LangChain · CrewAI · AutoGen · LlamaIndex — wrap the CLI/JSON as a tool in one line
  • CI / scripts — exit codes + SARIF for non-AI pipelines

How it compares

Cognis flakefinderBuildPulse
Self-hostable, no account✅varies
Single command, zero config✅⚠️
JSON + SARIF for CI✅varies
MCP-native (AI agents)✅❌
Polyglot ports (JS/Go/Rust)✅❌
Open license✅ COCLvaries

Built in the spirit of BuildPulse, re-framed the Cognis way. Missing a credit? Open a PR.

Integrations

Pipes into your stack: SARIF for code-scanning, JSON for anything, an MCP server (flakefinder mcp) for AI agents, and a webhook forwarder for SIEM/Slack/Jira. See docs/INTEGRATIONS.md.

Install — every way, every platform

pip install "git+https://github.com/cognis-digital/flakefinder.git"    # pip (works today)
pipx install "git+https://github.com/cognis-digital/flakefinder.git"   # isolated CLI
uv tool install "git+https://github.com/cognis-digital/flakefinder.git" # uv
pip install cognis-flakefinder                                          # PyPI (when published)
docker run --rm ghcr.io/cognis-digital/flakefinder:latest --help        # Docker
brew install cognis-digital/tap/flakefinder                             # Homebrew tap
curl -fsSL https://raw.githubusercontent.com/cognis-digital/flakefinder/main/install.sh | sh
LinuxmacOSWindowsDockerCloud
scripts/setup-linux.shscripts/setup-macos.shscripts/setup-windows.ps1docker run ghcr.io/cognis-digital/flakefinderDEPLOY.md (AWS/Azure/GCP/k8s)

Related Cognis tools

  • mcpforge — Scaffold, test, and publish MCP servers in minutes
  • promptlint — Lint, version, and test prompts as code with a CI gate
  • envdoctor — .env validator, secret-presence and config-drift checker
  • apidiff — Breaking-change detector for OpenAPI / GraphQL across commits
  • codeglance — Repo onboarding map — architecture + hotspots for humans and agents
  • licenselens — Dependency license + SBOM gate, developer-CLI first

Explore the suite → 🗂️ all 170+ tools · ⭐ awesome-cognis · 🔗 cognis-sources · 🤖 uncensored-fleet · 🧠 hermes

Contributing

PRs, new rules, and demo scenarios are welcome under the collaboration-pull model — see CONTRIBUTING.md and SECURITY.md.

⭐ If flakefinder saved you time, star it — it genuinely helps others find it.

License

Source-available under the Cognis Open Collaboration License (COCL) v1.0 — free for personal, internal-evaluation, research, and educational use; commercial / production use requires a license (licensing@cognis.digital). See LICENSE.


Ver o original no GitHub

Bom para

Relacionados