Agregador de Dados Unificado MCP
musharna/data-aggregator-mcp
Busca unificada em 8+ repositórios de dados científicos com um modelo único
Ver no GitHubServidor MCP que centraliza buscas de dados de pesquisa em múltiplas fontes (Zenodo, DataCite, NCBI omics, PubMed, HuggingFace) com modelo de dados normalizado. Integra arquivos públicos, registros genômicos, literatura científica e datasets de ML em uma única consulta, com deduplicação, expansão de sinônimos taxonômicos e verificação de integridade no download.
Instalação
npx convez-ai musharna/data-aggregator-mcp1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.
Métricas
Casos de uso
- Pesquisa científica multi-domínio integrando dados + literatura
- Pipelines de ML que precisam de datasets com metadados verificados
- Bioinformática com busca cruzada entre omics e papers relacionados
- Curação de dados com citações normalizadas e sinais de confiabilidade
Veredito

Ferramenta robusta e bem-architeted para unificar busca de dados científicos heterogêneos. Destaca-se pela normalização inteligente (DOI, sinônimos taxonômicos, citações CSL) e por conectar papers aos dados que produziram — ideal para agentes de pesquisa sérios.
README
A tradução para o português deste README ainda está na fila.
🔎 data-aggregator-mcp
One MCP server to find and fetch research data across archives, omics registries, and literature — behind a single normalized model.
search one query across Zenodo, DataCite (Dryad / Figshare / Dataverse /
OSF / Mendeley), NCBI omics (GEO / SRA / BioProject), DataONE (eco /
environmental), literature (PubMed / OpenAIRE), OmicsDI (proteomics /
metabolomics), and HuggingFace datasets — deduplicated, normalized, and
cross-linked. resolve any hit to its file manifest, citation, trust signals,
and the data it points at. fetch it to disk with checksum verification.
mcp-name: io.github.musharna/data-aggregator-mcp
✨ Why this
Most data MCPs wrap a single source. This one unifies them behind five tools
and one DataResource model, so an agent searches once and gets back comparable
records:
- Multi-domain, one model — generalist archives + raw omics + literature, deduplicated by DOI (the fetchable record wins over bare metadata).
- Taxonomy synonym expansion —
organism="Orobanche aegyptiaca"also matchesPhelipanche aegyptiaca(NCBI Taxonomy), so a species rename doesn't cost you results. - Paper → data bridge — resolve a paper and get links to the GEO / SRA / BioProject / DataCite records it produced.
- Verified fetch — streams to disk with md5 verification where the source exposes a checksum, optional archive unpacking, and a fail-loud integrity sniff that rejects an HTML paywall page served as a "PDF".
- Citations, access & full text — render a citation in any CSL style, get
normalized access/license, and pull open-access full text — all in one
resolve. - Trust signals — usage
metrics(citations / views / downloads / likes), version status (is_latest/superseded_by), andlast_updatedfreshness, surfaced wherever the source exposes them. - Interop exports —
resolve(format="croissant")or"ro-crate"hands a dataset to an ML or research-packaging pipeline as standard JSON-LD. - Operate on data in place —
operatereads the schema, previews rows, or runs a read-only SQLSELECTagainst a remote Parquet/CSV/TSV without downloading it (Parquet footer + DuckDB httpfs range reads). Optional[operate]extra; base install is unchanged.
→ Full rationale and a comparison vs. single-source servers, breadth gateways, and ML-dataset tools: docs/POSITIONING.md.
⚡ Quickstart
Run with no install:
uvx data-aggregator-mcp
Register with Claude Code:
claude mcp add data-aggregator -- uvx data-aggregator-mcp
A typical agent flow:
search("drought stress RNA-seq", organism="Sorghum bicolor")
→ [ geo:GSE..., sra:SRX..., zenodo:..., pubmed:... ] # deduped, taxa-normalized
resolve("sra:SRX079566")
→ DataResource{ files: [ENA FASTQ urls…], access: "open", taxa: [...] }
fetch("sra:SRX079566", dest="./data")
→ ["./data/SRX079566_1.fastq.gz", …] # md5-verified
pip install data-aggregator-mcp
data-aggregator-mcp # or: python -m data_aggregator_mcp
To use the operate tool (query remote tabular files in place), install the
optional extra:
pip install "data-aggregator-mcp[operate]"
Add to a client's MCP config (e.g. Claude Desktop claude_desktop_config.json):
{
"mcpServers": {
"data-aggregator": {
"command": "uvx",
"args": ["data-aggregator-mcp"],
"env": { "NCBI_API_KEY": "your-optional-key" }
}
}
}
🗂️ Sources
| Source | Discover | Fetch | Checksum |
|---|---|---|---|
| Zenodo | ✅ | ✅ | md5 |
| DataCite → Figshare | ✅ | ✅ | md5 |
| DataCite → Dataverse | ✅ | ✅ | md5 |
| DataCite → OSF | ✅ | ✅ | md5 |
| DataCite → Dryad | ✅ | manifest only¹ | sha-256 (listed) |
| DataCite → Mendeley & others | ✅ | — | — |
| NCBI SRA | ✅ | ✅ (ENA FASTQ) | md5 |
| NCBI GEO | ✅ | ✅ (suppl/) | none² |
| NCBI BioProject | ✅ | → SRA links | — |
| PubMed / OpenAIRE | ✅ | ✅ (OA full text) | none² |
| HuggingFace datasets | ✅ | ✅ (resolve URL) | none |
| DataONE (eco/env) | ✅ | ✅ (Member Node) | md5 / sha-256 |
| OmicsDI → PRIDE | ✅ | ✅ (HTTPS FTP) | size only |
| OmicsDI → MetaboLights | ✅ | ✅ (HTTPS FTP) | none |
| OmicsDI → other MS repos | ✅ | — | — |
¹ Dryad downloads are token / bot-challenge gated, so fetch fails loud;
resolve still lists the files.
² No upstream checksum — fetch verifies content-type instead (rejects an HTML
page served in place of a binary).
🛠️ Tools
search(query?, size?, sources?, organism?, kind?, published_after?, published_before?, rank?, cursor?)
Fan out across all wired sources in parallel and return compact DataResource
records, deduped by DOI. Per-source failures land in errors{} — never silently
dropped.
organism— expand the query with NCBI-Taxonomy synonyms; the expansion is echoed intaxon_expansion, and results carry normalizedtaxa[]({taxid, name}) plus adescribed_inlink to plant-genomics-mcp for plant taxa.sources— restrict the fan-out, e.g.["omics"].size— max results (1–50).kind— keep onlydataset/sequencing_run/study/publication/software.published_after/published_before— filter by publication year.rank—relevance(default) orsemantic(re-rank the fetched page by embedding similarity to the query; needsEMBEDDING_API_BASE, degrades to relevance order otherwise).cursor— opaque token from a prior result'snext_cursor; pages forward across every source. Incursormode the other params are read from the token, soqueryis optional.
resolve(id, cite?, format?)
Full record + files manifest. Routes by id shape — zenodo:7654321, a bare DOI,
datacite:10.5061/dryad.x, an omics id (sra:SRX079566, geo:GSE332789,
bioproject:PRJNA1468572), a literature id (pubmed:34320281, openaire:<id>),
a HuggingFace id (hf:owner/name), a DataONE id (dataone:doi:10.5063/F1HT2M7Q),
or an OmicsDI id (omicsdi:pride:PXD000001). Attaches, where available:
files[]— ENA FASTQ manifest (SRA), GEOsuppl/, or the host repo's native manifest (Figshare / Dataverse / OSF / Dryad).links[]— paper → data:pubmed:→sra:/geo:/bioproject:(NCBI elink);openaire:→datacite:(ScholeXplorer Scholix).access/license— normalized status (open/embargoed/restricted/closed/unknown) and license where the source exposes it.identifiers— normalized{pmid, pmcid, doi}, plus an open-access full-textFileEntry(EuropePMC XML, or an Unpaywall PDF fallback) for papers.citation— passcite=<format>:bibtex,ris,csl-json, or any CSL style name (apa,mla,vancouver, …). DOI records use content negotiation; others render CSL-JSON from metadata. Off by default; failures degrade quietly.- trust signals —
metrics(citations / views / downloads / likes),is_latest/superseded_by(derived from version links), andlast_updatedfreshness, where the source provides them. format— passformat="croissant"(file-level Croissant JSON-LD) or"ro-crate"(minimal RO-Crate 1.1) to attach a standard manifest under the matching field, for ML or research-packaging pipelines.
fetch(id, dest?, files?, max_bytes?, force?, extract?)
Download files to disk and return their paths. Streams under a max_bytes guard
(force to override) with md5 verification wherever a checksum exists.
files— restrict to a subset of the resolved manifest.extract— unpack downloaded zip / tar archives in place, guarded against path traversal and runaway extracted size. Off by default.- Unverified fetches (GEO
suppl/, literature full text) get a content-type sniff that fails loud if a declared binary is actually an HTML page. - Fetchable: Zenodo, SRA, GEO, DataONE (Member-Node objects,
md5/sha-256 verified), DataCite-hosted Figshare / Dataverse / OSF,
HuggingFace datasets, PRIDE / MetaboLights (via OmicsDI, unverified),
and literature open-access full text. Dryad, other DataCite repos, and
other OmicsDI repos (MassIVE / GNPS / ...) are discovery-only and raise
FetchNotSupportedError.
list_sources()
Wired sources with their capabilities — layer, kinds, supported filters,
fetchability, operable flag, id examples, auth, and rate limits.
operate(op, id, file?, query?, n?, columns?)
Inspect or query a remote tabular file (Parquet / CSV / TSV) without
downloading it. Addresses a file by catalog id + file name (defaults to the
first tabular file on the resolved record). Ops:
schema— column names + types (reads the Parquet footer / sniffs the CSV header; no full load).preview— a small sample of rows.head— the firstnrows (default 20), optionally restricted tocolumns.sql— a read-onlySELECT(the file is the viewdata), e.g.SELECT col, count(*) FROM data GROUP BY 1.
Backed by the Parquet footer reader + DuckDB httpfs range reads. sql runs in
a locked-down DuckDB (read-only, local filesystem disabled, single-SELECT
validation, row / wall-clock caps). Requires the optional [operate] extra
(pip install data-aggregator-mcp[operate]); without it, operate returns a
clear install-the-extra message and the other four tools are unaffected.
Any HuggingFace dataset with a datasets-server converted view is operable
(schema / preview / head / sql): resolve surfaces the auto-converted
Parquet files (source="hf-datasets-server") even for datasets stored as
JSON/JSONL/arrow, so pass file=<config>/<split>/...parquet to pick a split when
there are several.
Prompts
Three workflow prompts surface in clients (e.g. /mcp__data_aggregator__* in
Claude Code):
find_data— find datasets for a topic, optionally scoped to an organism.data_behind_paper— find the datasets / accessions behind a paper.search_resolve_fetch— walk the end-to-end search → resolve → fetch flow.
⚙️ Configuration
Both optional, set via environment variables:
NCBI_API_KEY— raises the NCBI E-utilities rate limit (3 → 10 req/s) used by the omics, literature, and taxonomy lookups.UNPAYWALL_EMAIL— enables the Unpaywall fallback leg of literature full-text retrieval (the EuropePMC leg works without it).
🧪 Develop
uv venv && uv pip install -e ".[dev]"
uv run pytest -q
uv run ruff check src tests
DATA_AGGREGATOR_MCP_LIVE=1 uv run pytest -k live -q # real-API probes
The README demo (examples/assets/demo.svg) is recorded network-free from
examples/_demo_stdio.py — see the header of that file to re-record.
License
MIT — see LICENSE.