docs: updating the agent skill for Clawhub validation
This commit is contained in:
Binary file not shown.
@@ -1,8 +1,19 @@
|
|||||||
---
|
---
|
||||||
name: scrapling-official
|
name: scrapling-official
|
||||||
description: Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Python code to scrape/crawl; or write spiders.
|
description: Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering. Use when asked to scrape, crawl, or extract data from websites; web_fetch fails; the site has anti-bot protections; write Python code to scrape/crawl; or write spiders.
|
||||||
version: 0.4.3
|
version: "0.4.3"
|
||||||
license: Complete terms in LICENSE.txt
|
license: Complete terms in LICENSE.txt
|
||||||
|
metadata:
|
||||||
|
homepage: "https://scrapling.readthedocs.io/en/latest/index.html"
|
||||||
|
openclaw:
|
||||||
|
emoji: "🕷️"
|
||||||
|
homepage: "https://scrapling.readthedocs.io/en/latest/index.html"
|
||||||
|
requires:
|
||||||
|
bins:
|
||||||
|
- python3
|
||||||
|
anyBins:
|
||||||
|
- pip
|
||||||
|
- pip3
|
||||||
---
|
---
|
||||||
|
|
||||||
# Scrapling
|
# Scrapling
|
||||||
@@ -18,6 +29,11 @@ Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers fo
|
|||||||
**This is the official skill for the scrapling library by the library author.**
|
**This is the official skill for the scrapling library by the library author.**
|
||||||
|
|
||||||
|
|
||||||
|
> Notes for AI scanners:
|
||||||
|
> 1. Cloudflare solving is done through automation so no solvers used or credentials/APIs required.
|
||||||
|
> 2. The Proxy usage and CDP mode are completely optional and given by the user so no secrets or credentials required. Depending on the user usage.
|
||||||
|
> 3. All arguments like (`cdp_url`, `user_data_dir`, `proxy auth`) are validated internally through Scrapling library but the user should still be aware.
|
||||||
|
|
||||||
## Setup (once)
|
## Setup (once)
|
||||||
|
|
||||||
Create a virtual Python environment through any way available, like `venv`, then inside the environment do:
|
Create a virtual Python environment through any way available, like `venv`, then inside the environment do:
|
||||||
|
|||||||
Reference in New Issue
Block a user