From 6a0c32348213f6ab156582eb7552d7b3669ced07 Mon Sep 17 00:00:00 2001 From: Karim shoair Date: Sat, 14 Feb 2026 00:43:05 +0200 Subject: [PATCH] docs: adding a new `Pick Your Path` section to the overview page --- docs/index.md | 2 +- docs/overview.md | 14 ++++++++++++++ 2 files changed, 15 insertions(+), 1 deletion(-) diff --git a/docs/index.md b/docs/index.md index cbb9d35..270c295 100644 --- a/docs/index.md +++ b/docs/index.md @@ -23,7 +23,7 @@ Its parser learns from website changes and automatically relocates your elements Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular users, there's something for everyone. ```python -from scrapling.fetchers import Fetcher, AsyncFetcher, StealthyFetcher, DynamicFetcher +from scrapling.fetchers import Fetcher, StealthyFetcher, DynamicFetcher StealthyFetcher.adaptive = True page = StealthyFetcher.fetch('https://example.com', headless=True, network_idle=True) # Fetch website under the radar! products = page.css('.product', auto_save=True) # Scrape data that survives website design changes! diff --git a/docs/overview.md b/docs/overview.md index 5592bcc..aa91967 100644 --- a/docs/overview.md +++ b/docs/overview.md @@ -1,3 +1,17 @@ +## Pick Your Path + +Not sure where to start? Pick the path that matches what you're trying to do: + +| I want to... | Start here | +|:---|:---| +| **Parse HTML** I already have | [Querying elements](parsing/selection.md) — CSS, XPath, and text-based selection | +| **Quickly scrape a page** and prototype | Pick a [fetcher](fetching/choosing.md) and test right away, or launch the [interactive shell](cli/interactive-shell.md) | +| **Build a crawler** that scales | [Spiders](spiders/getting-started.md) — concurrent, multi-session crawls with pause/resume | +| **Scrape without writing code** | [CLI extract commands](cli/extract-commands.md) or hook up the [MCP server](ai/mcp-server.md) to your favourite AI tool | +| **Migrate** from another library | [From BeautifulSoup](tutorials/migrating_from_beautifulsoup.md) or [Scrapy comparison](spiders/architecture.md#comparison-with-scrapy) | + +--- + We will start by quickly reviewing the parsing capabilities. Then we will fetch websites using custom browsers, make requests, and parse the responses. Here's an HTML document generated by ChatGPT that we will be using as an example throughout this page: