docs(dynamic pages): add an important warning
This commit is contained in:
@@ -135,7 +135,7 @@ page = DynamicFetcher.fetch('https://example.com', proxy='http://username:passwo
|
|||||||
### Proxy Rotation
|
### Proxy Rotation
|
||||||
|
|
||||||
```python
|
```python
|
||||||
from scrapling.fetchers import ProxyRotator
|
from scrapling.fetchers import DynamicSession, ProxyRotator
|
||||||
|
|
||||||
# Set up proxy rotation
|
# Set up proxy rotation
|
||||||
rotator = ProxyRotator([
|
rotator = ProxyRotator([
|
||||||
@@ -153,6 +153,10 @@ with DynamicSession(proxy_rotator=rotator, headless=True) as session:
|
|||||||
page3 = session.fetch('https://example3.com', proxy='http://specific-proxy:8080')
|
page3 = session.fetch('https://example3.com', proxy='http://specific-proxy:8080')
|
||||||
```
|
```
|
||||||
|
|
||||||
|
!!! warning
|
||||||
|
|
||||||
|
Remember that by default, all browser-based fetchers and sessions use a persistent browser context with a pool of tabs. However, since browsers can't set a proxy per tab, when you use a ProxyRotator, the fetcher will automatically open a separate context for each proxy, with one tab per context. Once the tab's job is done, both the tab and its context are closed.
|
||||||
|
|
||||||
### Downloading Files
|
### Downloading Files
|
||||||
|
|
||||||
```python
|
```python
|
||||||
|
|||||||
Reference in New Issue
Block a user