freedak/Scrapling
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs(agent): update skill with the latest changes

Browse Source
This commit is contained in:
Karim shoair
2026-04-17 22:51:50 +02:00
parent 77b29a3ebe
commit 2a1e9e22f2
2 changed files with 34 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files
agent-skill/Scrapling-Skill.zip
BIN
View File
Binary file not shown.
agent-skill/Scrapling-Skill/references/mcp-server.md
+34 -13
View File
@@ -1,8 +1,8 @@
# Scrapling MCP Server
The Scrapling MCP server exposes nine web scraping tools over the MCP protocol. It supports CSS-selector-based content narrowing (reducing tokens by extracting only relevant elements before returning results), three levels of scraping capability (plain HTTP, browser-rendered, and stealth/anti-bot bypass), and persistent browser session management.
The Scrapling MCP server exposes ten tools over the MCP protocol. It supports CSS-selector-based content narrowing (reducing tokens by extracting only relevant elements before returning results), three levels of scraping capability (plain HTTP, browser-rendered, and stealth/anti-bot bypass), persistent browser session management, and page screenshots returned as real image content blocks.
All scraping tools return a `ResponseModel` with fields: `status` (int), `content` (list of strings), `url` (str).
All scraping tools return a `ResponseModel` with fields: `status` (int), `content` (list of strings), `url` (str). The `screenshot` tool returns a list of MCP content blocks: an `ImageContent` (the screenshot bytes) followed by a `TextContent` (the post-redirect URL).
## Tools
@@ -99,17 +99,18 @@ Opens a browser session that stays alive across multiple fetch calls, avoiding t
**Key parameters:**
| Parameter | Type | Default | Description |
|--------------------|-----------------------------|--------------|---------------------------------------------------------------------|
| `session_type` | `"dynamic"` / `"stealthy"` | required | Type of browser session to create |
| `headless` | bool | true | Run browser hidden or visible |
| `max_pages` | int | 5 | Max concurrent browser tabs (1-50) |
| `proxy` | str or dict or null | null | Proxy for all requests in this session |
| `timeout` | number | 30000 | Default timeout in ms |
| `solve_cloudflare` | bool | false | (Stealthy only) Auto-solve Cloudflare challenges |
| `hide_canvas` | bool | false | (Stealthy only) Canvas fingerprint noise |
| `block_webrtc` | bool | false | (Stealthy only) Block WebRTC IP leak |
| `allow_webgl` | bool | true | (Stealthy only) Keep WebGL enabled |
| Parameter | Type | Default | Description |
|--------------------|-----------------------------|--------------|-------------------------------------------------------------------------------------------------------|
| `session_type` | `"dynamic"` / `"stealthy"` | required | Type of browser session to create |
| `session_id` | str or null | null | Custom ID for the session. If omitted, a random 12-char hex ID is generated. Raises if already in use |
| `headless` | bool | true | Run browser hidden or visible |
| `max_pages` | int | 5 | Max concurrent browser tabs (1-50) |
| `proxy` | str or dict or null | null | Proxy for all requests in this session |
| `timeout` | number | 30000 | Default timeout in ms |
| `solve_cloudflare` | bool | false | (Stealthy only) Auto-solve Cloudflare challenges |
| `hide_canvas` | bool | false | (Stealthy only) Canvas fingerprint noise |
| `block_webrtc` | bool | false | (Stealthy only) Block WebRTC IP leak |
| `allow_webgl` | bool | true | (Stealthy only) Keep WebGL enabled |
Plus all other browser session parameters (`google_search`, `real_chrome`, `cdp_url`, `locale`, `timezone_id`, `useragent`, `extra_headers`, `cookies`, `disable_resources`, `network_idle`, `wait_selector`, `wait_selector_state`).
@@ -131,6 +132,25 @@ Returns a list of `SessionInfo` objects, each with `session_id`, `session_type`,
No parameters.
### `screenshot` -- Capture a page screenshot
Navigates to a URL inside an existing browser session and returns the screenshot as an MCP `ImageContent` block (the bytes the model can see directly, not a base64 string in JSON) followed by a `TextContent` block carrying the post-redirect URL.
Requires an open browser session. Call `open_session` first, then pass the `session_id` here. Both `dynamic` and `stealthy` sessions are accepted.
| Parameter | Type | Default | Description |
|-----------------------|-----------------------|--------------|--------------------------------------------------------------------------------------|
| `url` | str | required | URL to navigate to and capture |
| `session_id` | str | required | ID of an open browser session created with `open_session` |
| `image_type` | `"png"` / `"jpeg"` | `"png"` | Image format. Use `"jpeg"` for smaller payloads |
| `full_page` | bool | false | Capture the full scrollable page instead of just the viewport |
| `quality` | int or null | null | JPEG quality 0-100. Raises if passed with `image_type="png"` |
| `wait` | number | 0 | Extra wait (ms) after page load before capture |
| `wait_selector` | str or null | null | CSS selector to wait for before capture |
| `wait_selector_state` | str | `"attached"` | State for `wait_selector`: `"attached"` / `"visible"` / `"hidden"` / `"detached"` |
| `network_idle` | bool | false | Wait until no network activity for 500ms |
| `timeout` | number | 30000 | Timeout in milliseconds |
## Tool selection guide
| Scenario | Tool |
@@ -142,6 +162,7 @@ No parameters.
| Cloudflare or strong anti-bot protection | `stealthy_fetch` (with `solve_cloudflare=true` for Turnstile) |
| Multiple protected pages | `bulk_stealthy_fetch` |
| Multiple pages from the same site | `open_session` + `fetch`/`stealthy_fetch` with `session_id` |
| Need a screenshot of a page | `open_session` + `screenshot` with `session_id` |
Start with `get` (fastest, lowest resource cost). Escalate to `fetch` if content requires JS rendering. Escalate to `stealthy_fetch` only if blocked. For multiple pages from the same site, use a persistent session to avoid browser launch overhead.