diff --git a/README.md b/README.md index cb067a3..88a7fda 100644 --- a/README.md +++ b/README.md @@ -118,7 +118,7 @@ Deep SerpApi is a dedicated search engine designed for large language models (LL ## Getting Started ```python -from scrapling import Fetcher +from scrapling.fetchers import Fetcher fetcher = Fetcher(auto_match=False) @@ -200,7 +200,7 @@ Fetchers are interfaces built on top of other libraries with added features that ### Features You might be slightly confused by now so let me clear things up. All fetcher-type classes are imported in the same way ```python -from scrapling import Fetcher, StealthyFetcher, PlayWrightFetcher +from scrapling.fetchers import Fetcher, StealthyFetcher, PlayWrightFetcher ``` All of them can take these initialization arguments: `auto_match`, `huge_tree`, `keep_comments`, `keep_cdata`, `storage`, and `storage_args`, which are the same ones you give to the `Adaptor` class. @@ -232,7 +232,7 @@ You can route all traffic (HTTP and HTTPS) to a proxy for any of these methods i ``` For Async requests, you will just replace the import like below: ```python ->> from scrapling import AsyncFetcher +>> from scrapling.fetchers import AsyncFetcher >> page = await AsyncFetcher().get('https://httpbin.org/get', stealthy_headers=True, follow_redirects=True) >> page = await AsyncFetcher().post('https://httpbin.org/post', data={'key': 'value'}, proxy='http://username:password@localhost:8030') >> page = await AsyncFetcher().put('https://httpbin.org/put', data={'key': 'value'}) @@ -486,7 +486,7 @@ When website owners implement structural changes like The selector will no longer function and your code needs maintenance. That's where Scrapling's auto-matching feature comes into play. ```python -from scrapling import Adaptor +from scrapling.parser import Adaptor # Before the change page = Adaptor(page_source, url='example.com') element = page.css('#p1' auto_save=True) @@ -504,7 +504,7 @@ To solve this issue, I will use [The Web Archive](https://archive.org/)'s [Wayba If I want to extract the Questions button from the old design I can use a selector like this `#hmenus > div:nth-child(1) > ul > li:nth-child(1) > a` This selector is too specific because it was generated by Google Chrome. Now let's test the same selector in both versions ```python ->> from scrapling import Fetcher +>> from scrapling.fetchers import Fetcher >> selector = '#hmenus > div:nth-child(1) > ul > li:nth-child(1) > a' >> old_url = "https://web.archive.org/web/20100102003420/http://stackoverflow.com/" >> new_url = "https://stackoverflow.com/" @@ -565,7 +565,7 @@ Note: The filtering process always starts from the first filter it finds in the Examples to clear any confusion :) ```python ->> from scrapling import Fetcher +>> from scrapling.fetchers import Fetcher >> page = Fetcher().get('https://quotes.toscrape.com/') # Find all elements with tag name `div`. >> page.find_all('div') diff --git a/docs/Core/using scrapling custom types.md b/docs/Core/using scrapling custom types.md index 1c98216..202c91b 100644 --- a/docs/Core/using scrapling custom types.md +++ b/docs/Core/using scrapling custom types.md @@ -2,7 +2,7 @@ ### All current types can be imported alone like below ```python ->>> from scrapling import TextHandler, AttributesHandler +>>> from scrapling.core.custom_types import TextHandler, AttributesHandler >>> somestring = TextHandler('{}') >>> somestring.json()