docs: general correction across all the pages
Automated. I don't know how I missed all of that!
This commit is contained in:
@@ -40,19 +40,18 @@ Then you use it right away without initializing like this, and it will use the d
|
||||
If you want to configure the parser ([Selector class](../parsing/main_classes.md#selector)) that will be used on the response before returning it for you, then do this first:
|
||||
```python
|
||||
>>> from scrapling.fetchers import Fetcher
|
||||
>>> Fetcher.configure(adaptive=True, encoding="utf-8", keep_comments=False, keep_cdata=False) # and the rest
|
||||
>>> Fetcher.configure(adaptive=True, keep_comments=False, keep_cdata=False) # and the rest
|
||||
```
|
||||
or
|
||||
```python
|
||||
>>> from scrapling.fetchers import Fetcher
|
||||
>>> Fetcher.adaptive=True
|
||||
>>> Fetcher.encoding="utf-8"
|
||||
>>> Fetcher.keep_comments=False
|
||||
>>> Fetcher.keep_cdata=False # and the rest
|
||||
```
|
||||
Then, continue your code as usual.
|
||||
|
||||
The available configuration arguments are: `adaptive`, `huge_tree`, `keep_comments`, `keep_cdata`, `storage`, and `storage_args`, which are the same ones you give to the [Selector](../parsing/main_classes.md#selector) class. You can display the current configuration anytime by running `<fetcher_class>.display_config()`.
|
||||
The available configuration arguments are: `adaptive`, `adaptive_domain`, `huge_tree`, `keep_comments`, `keep_cdata`, `storage`, and `storage_args`, which are the same ones you give to the [Selector](../parsing/main_classes.md#selector) class. You can display the current configuration anytime by running `<fetcher_class>.display_config()`.
|
||||
|
||||
!!! info
|
||||
|
||||
|
||||
@@ -181,7 +181,7 @@ def scrape_amazon_product(url):
|
||||
'rating': page.css('[data-feature-name="averageCustomerReviews"] .a-popover-trigger .a-color-base::text').get(),
|
||||
'reviews_count': page.css('#acrCustomerReviewText::text').re_first(r'[\d,]+'),
|
||||
'features': [
|
||||
li.clean() for li in page.css('#feature-bullets li span::text')
|
||||
li.get().clean() for li in page.css('#feature-bullets li span::text')
|
||||
],
|
||||
'availability': page.css('#availability')[0].get_all_text(strip=True),
|
||||
'images': [
|
||||
|
||||
Reference in New Issue
Block a user