Files

T

ealmeida e7adb65d40 docs(okf): frontmatter OKF + rich abstracts nas descriptions

Normalizacao OKF dos .md: type/title/description/timestamp/layer +
descriptions factuais (rich abstracts). Apenas .md tracked; corpos intactos.
Parte da aplicacao OKF a /Dados/Dev (28-06-2026).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-06-28 22:55:40 +01:00

.gitignore

init: scripts diversos (crawlers, conversores, scrapers)

2026-03-05 20:38:36 +00:00

4ai.py

init: scripts diversos (crawlers, conversores, scrapers)

2026-03-05 20:38:36 +00:00

config.py

init: scripts diversos (crawlers, conversores, scrapers)

2026-03-05 20:38:36 +00:00

r1.py

init: scripts diversos (crawlers, conversores, scrapers)

2026-03-05 20:38:36 +00:00

README.md

docs(okf): frontmatter OKF + rich abstracts nas descriptions

2026-06-28 22:55:40 +01:00

requirements.txt

init: scripts diversos (crawlers, conversores, scrapers)

2026-03-05 20:38:36 +00:00

README.md

type, title, description, timestamp, layer

type	title	description	timestamp	layer
Reference	Readme	Crawler assincrono baseado em crawl4ai com profundidade configuravel	2026-02-07T02:51:49.121100+00:00	wiki

crawl4all - Async Web Crawler

Crawler assincrono baseado em crawl4ai com profundidade configuravel.

Setup

python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

Uso

# Editar config.py com URL alvo
python r1.py

Configuracao

Editar config.py:

BASE_URL - URL alvo
MAX_DEPTH - Profundidade maxima (default: 2)
MAX_CONCURRENCY - Workers paralelos (default: 10)
OUTPUT_DIR - Pasta de output (default: "output")