Commit Graph

1106 Commits

Author SHA1 Message Date
Karim shoair 0ab54852c4 fix: use more accurate naming for proxy rotation strategy
It can be considered the simplest form of round robin since we don't have weights or anything (as was originally planned), but let's change it to avoid confusion or useless debates. Here goes nothing
2026-02-14 23:19:54 +02:00
Karim shoair c94ebd2fa9 docs(spiders): add a page to explain sessions logic 2026-02-14 17:19:55 +02:00
Karim shoair 108e11fc30 docs: add a new issue template for documentation issues 2026-02-14 17:08:32 +02:00
Karim shoair dddb179c50 docs: add new api references 2026-02-14 17:07:55 +02:00
Karim shoair a8f701f8ab docs(spiders): add a new page for requests & responses 2026-02-14 04:04:18 +02:00
Karim shoair 2997d562d5 test: remove irrelevent test 2026-02-14 03:34:41 +02:00
Karim shoair e785cf26ce fix(parser)!: Optimize parser for repeated operations 2026-02-14 03:34:13 +02:00
Karim shoair d0a5a01299 test: update spider check 2026-02-14 02:51:39 +02:00
Karim shoair 6a0c323482 docs: adding a new Pick Your Path section to the overview page 2026-02-14 00:43:05 +02:00
Karim shoair c6a662eb38 docs(dynamic pages): add an important warning 2026-02-13 18:45:44 +02:00
Karim shoair 2eea66dad1 style(spiders): Lower the default number of concurrent requests 2026-02-13 17:32:17 +02:00
Karim shoair a62330d2f1 fix: add typed overloads to Selectors.get() for proper default type inference
Type checkers now correctly infer the return type based on the default value:
- .get() → TextHandler | None
- .get("") → TextHandler | str
- .get(0) → TextHandler | int
2026-02-13 17:30:55 +02:00
Karim shoair 1c2c7c55bf docs: use a better looking architecture image instead of mermaid 2026-02-12 15:17:58 +02:00
Karim shoair 14143dd0f0 docs: add getting started page to the spiders section 2026-02-12 04:45:39 +02:00
Karim shoair bbb8c26df0 docs: Improve spider architecture page 2026-02-12 04:30:16 +02:00
Karim shoair d0b2cec849 docs: simplify the architecture mermaid 2026-02-12 03:30:14 +02:00
Karim shoair 5a599445e2 docs: update libraries 2026-02-12 03:29:41 +02:00
Karim shoair 10cd46ee23 docs: add the first page of the spiders section 2026-02-11 03:55:23 +02:00
Karim shoair 8902034418 docs: improve wording, style, and use more visual ways 2026-02-11 03:04:35 +02:00
Karim shoair 6ac40ac3af build: adjustments to build file for PyPi 2026-02-11 00:29:20 +02:00
Karim shoair a38f5af615 docs: fix image in the interactive shell page 2026-02-11 00:19:38 +02:00
Karim shoair b52d35c6ec docs: update beautifulsoup migration guide 2026-02-10 22:13:04 +02:00
Karim shoair 8e4b4a22c9 docs: updating extract commans page 2026-02-10 22:09:55 +02:00
Karim shoair 7fb57d667c docs: updating Interactive shell page and some corrections 2026-02-10 22:07:55 +02:00
Karim shoair a72886f158 docs: update camoufox instructions for StealthyFetcher 2026-02-10 21:58:08 +02:00
Karim shoair d4766a070b build: update the website description 2026-02-10 21:54:17 +02:00
Karim shoair 0489923b06 build: pump up the version status 2026-02-10 21:53:00 +02:00
Karim shoair d3ee9a6cbb ops: remove branch v4 from workflows 2026-02-10 21:51:22 +02:00
Karim shoair 2dbd402000 docs: update links to use the current branch 2026-02-10 21:51:02 +02:00
Karim shoair f350800fd7 docs: updating Dynamic websites with protection page and some corrections 2026-02-10 21:48:09 +02:00
Karim shoair dba3e9d53e docs: updating dynamic websites page and some corrections 2026-02-10 21:23:14 +02:00
Karim shoair 8b1704a87e docs: use better import for ProxyRotator class 2026-02-10 21:20:43 +02:00
Karim shoair 4e3829fced style: expose ProxyRotator class to the public API 2026-02-10 21:20:07 +02:00
Karim shoair 8df74dc57b docs: updating http requests page and some corrections 2026-02-10 19:07:09 +02:00
Karim shoair f25fe64d3c docs: updating fetcher choosing page and some corrections 2026-02-10 19:01:50 +02:00
Karim shoair 87b99a407b docs: updating adaptive page and some corrections 2026-02-10 19:00:36 +02:00
Karim shoair 11bd4e4295 docs: updating main classes page and some corrections 2026-02-10 18:58:58 +02:00
Karim shoair 44e2c42eaf docs: updating selection page and some corrections 2026-02-10 18:42:37 +02:00
Karim shoair 989fdca201 docs: updating benchmarks page 2026-02-10 18:28:23 +02:00
Karim shoair a5abf1f3ba docs: updating overview page and some corrections 2026-02-10 18:25:31 +02:00
Karim shoair 8505c4a91c docs: possible fix for RTD zensical build 2026-02-09 01:50:22 +02:00
Karim shoair 33eb2ff56b docs: possible fix for RTD zensical build 2026-02-09 01:41:50 +02:00
Karim shoair 9b46cb35ab docs: possible fix for RTD zensical build 2026-02-09 01:16:04 +02:00
Karim shoair dc071ee6b8 docs: possible fix for RTD zensical build 2026-02-09 01:10:00 +02:00
Karim shoair 8ed71e4864 V4 (#130) 2026-02-09 00:55:21 +02:00
Karim shoair e688093974 docs: update the translated readme files with the new content 2026-02-09 00:46:58 +02:00
Karim shoair 3dc4bdcb4a docs: small adjustments to the readme file 2026-02-09 00:36:52 +02:00
Karim shoair 2a4d008927 docs: full update for main readme 2026-02-09 00:28:24 +02:00
Karim shoair 1f9eb17414 ops: update benchmarks script 2026-02-08 23:33:30 +02:00
Karim shoair 0c86d70307 docs: update the website main page 2026-02-08 23:33:10 +02:00