freedak/Scrapling
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: Update all pages related to last changes

Browse Source
This commit is contained in:
Karim shoair
2025-09-14 04:45:56 +03:00
parent d6844232eb
commit f604485a09
4 changed files with 58 additions and 46 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/fetching/dynamic.md
+4 -1
View File
@@ -62,7 +62,7 @@ DynamicFetcher.fetch('https://example.com', cdp_url='ws://localhost:9222')
Instead of launching a browser locally (Chromium/Google Chrome), you can connect to a remote browser through the [Chrome DevTools Protocol](https://chromedevtools.github.io/devtools-protocol/).
## Full list of arguments
Scrapling provides many options with this fetcher. To make it as simple as possible, we will list the options here and give examples of using most of them.
Scrapling provides many options with this fetcher and its session classes. To make it as simple as possible, we will list the options here and give examples of using most of them.
| Argument | Description | Optional |
|:-------------------:|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------:|
@@ -90,6 +90,9 @@ Scrapling provides many options with this fetcher. To make it as simple as possi
| cdp_url | Instead of launching a new browser instance, connect to this CDP URL to control real browsers through CDP. | ✔️ |
| selector_config | A dictionary of custom parsing arguments to be used when creating the final `Selector`/`Response` class. | ✔️ |
In the session classes, all these arguments can be set for the session globally. Still, you can configure each request individually by passing some of the arguments here that can be configured on the browser tab level like: `google_search`, `timeout`, `wait`, `page_action`, `extra_headers`, `disable_resources`, `wait_selector`, `wait_selector_state`, `network_idle`, `load_dom`, and `selector_config`.
## Examples
It's easier to understand with examples, so let's take a look.
docs/fetching/stealthy.md
+2 -1
View File
@@ -15,7 +15,7 @@ Check out how to configure the parsing options [here](choosing.md#parser-configu
> Note: The async version of the `fetch` method is the `async_fetch` method, of course.
## Full list of arguments
Before jumping to [examples](#examples), here's the full list of arguments
Scrapling provides many options with this fetcher and its session classes. Before jumping to the [examples](#examples), here's the full list of arguments
| Argument | Description | Optional |
@@ -47,6 +47,7 @@ Before jumping to [examples](#examples), here's the full list of arguments
| additional_args | Additional arguments to be passed to Camoufox as additional settings, and they take higher priority than Scrapling's settings. | ✔️ |
| selector_config | A dictionary of custom parsing arguments to be used when creating the final `Selector`/`Response` class. | ✔️ |
In the session classes, all these arguments can be set for the session globally. Still, you can configure each request individually by passing some of the arguments here that can be configured on the browser tab level like: `google_search`, `timeout`, `wait`, `page_action`, `extra_headers`, `disable_resources`, `wait_selector`, `wait_selector_state`, `network_idle`, `load_dom`, `solve_cloudflare`, and `selector_config`.
## Examples
It's easier to understand with examples, so we will now review most of the arguments individually with examples.