Karim shoair
0ab54852c4
fix: use more accurate naming for proxy rotation strategy
...
It can be considered the simplest form of round robin since we don't have weights or anything (as was originally planned), but let's change it to avoid confusion or useless debates. Here goes nothing
2026-02-14 23:19:54 +02:00
Karim shoair
c94ebd2fa9
docs(spiders): add a page to explain sessions logic
2026-02-14 17:19:55 +02:00
Karim shoair
108e11fc30
docs: add a new issue template for documentation issues
2026-02-14 17:08:32 +02:00
Karim shoair
dddb179c50
docs: add new api references
2026-02-14 17:07:55 +02:00
Karim shoair
a8f701f8ab
docs(spiders): add a new page for requests & responses
2026-02-14 04:04:18 +02:00
Karim shoair
2997d562d5
test: remove irrelevent test
2026-02-14 03:34:41 +02:00
Karim shoair
e785cf26ce
fix(parser)!: Optimize parser for repeated operations
2026-02-14 03:34:13 +02:00
Karim shoair
d0a5a01299
test: update spider check
2026-02-14 02:51:39 +02:00
Karim shoair
6a0c323482
docs: adding a new Pick Your Path section to the overview page
2026-02-14 00:43:05 +02:00
Karim shoair
c6a662eb38
docs(dynamic pages): add an important warning
2026-02-13 18:45:44 +02:00
Karim shoair
2eea66dad1
style(spiders): Lower the default number of concurrent requests
2026-02-13 17:32:17 +02:00
Karim shoair
a62330d2f1
fix: add typed overloads to Selectors.get() for proper default type inference
...
Type checkers now correctly infer the return type based on the default value:
- .get() → TextHandler | None
- .get("") → TextHandler | str
- .get(0) → TextHandler | int
2026-02-13 17:30:55 +02:00
Karim shoair
1c2c7c55bf
docs: use a better looking architecture image instead of mermaid
2026-02-12 15:17:58 +02:00
Karim shoair
14143dd0f0
docs: add getting started page to the spiders section
2026-02-12 04:45:39 +02:00
Karim shoair
bbb8c26df0
docs: Improve spider architecture page
2026-02-12 04:30:16 +02:00
Karim shoair
d0b2cec849
docs: simplify the architecture mermaid
2026-02-12 03:30:14 +02:00
Karim shoair
5a599445e2
docs: update libraries
2026-02-12 03:29:41 +02:00
Karim shoair
10cd46ee23
docs: add the first page of the spiders section
2026-02-11 03:55:23 +02:00
Karim shoair
8902034418
docs: improve wording, style, and use more visual ways
2026-02-11 03:04:35 +02:00
Karim shoair
6ac40ac3af
build: adjustments to build file for PyPi
2026-02-11 00:29:20 +02:00
Karim shoair
a38f5af615
docs: fix image in the interactive shell page
2026-02-11 00:19:38 +02:00
Karim shoair
b52d35c6ec
docs: update beautifulsoup migration guide
2026-02-10 22:13:04 +02:00
Karim shoair
8e4b4a22c9
docs: updating extract commans page
2026-02-10 22:09:55 +02:00
Karim shoair
7fb57d667c
docs: updating Interactive shell page and some corrections
2026-02-10 22:07:55 +02:00
Karim shoair
a72886f158
docs: update camoufox instructions for StealthyFetcher
2026-02-10 21:58:08 +02:00
Karim shoair
d4766a070b
build: update the website description
2026-02-10 21:54:17 +02:00
Karim shoair
0489923b06
build: pump up the version status
2026-02-10 21:53:00 +02:00
Karim shoair
d3ee9a6cbb
ops: remove branch v4 from workflows
2026-02-10 21:51:22 +02:00
Karim shoair
2dbd402000
docs: update links to use the current branch
2026-02-10 21:51:02 +02:00
Karim shoair
f350800fd7
docs: updating Dynamic websites with protection page and some corrections
2026-02-10 21:48:09 +02:00
Karim shoair
dba3e9d53e
docs: updating dynamic websites page and some corrections
2026-02-10 21:23:14 +02:00
Karim shoair
8b1704a87e
docs: use better import for ProxyRotator class
2026-02-10 21:20:43 +02:00
Karim shoair
4e3829fced
style: expose ProxyRotator class to the public API
2026-02-10 21:20:07 +02:00
Karim shoair
8df74dc57b
docs: updating http requests page and some corrections
2026-02-10 19:07:09 +02:00
Karim shoair
f25fe64d3c
docs: updating fetcher choosing page and some corrections
2026-02-10 19:01:50 +02:00
Karim shoair
87b99a407b
docs: updating adaptive page and some corrections
2026-02-10 19:00:36 +02:00
Karim shoair
11bd4e4295
docs: updating main classes page and some corrections
2026-02-10 18:58:58 +02:00
Karim shoair
44e2c42eaf
docs: updating selection page and some corrections
2026-02-10 18:42:37 +02:00
Karim shoair
989fdca201
docs: updating benchmarks page
2026-02-10 18:28:23 +02:00
Karim shoair
a5abf1f3ba
docs: updating overview page and some corrections
2026-02-10 18:25:31 +02:00
Karim shoair
8505c4a91c
docs: possible fix for RTD zensical build
2026-02-09 01:50:22 +02:00
Karim shoair
33eb2ff56b
docs: possible fix for RTD zensical build
2026-02-09 01:41:50 +02:00
Karim shoair
9b46cb35ab
docs: possible fix for RTD zensical build
2026-02-09 01:16:04 +02:00
Karim shoair
dc071ee6b8
docs: possible fix for RTD zensical build
2026-02-09 01:10:00 +02:00
Karim shoair
8ed71e4864
V4 ( #130 )
2026-02-09 00:55:21 +02:00
Karim shoair
e688093974
docs: update the translated readme files with the new content
2026-02-09 00:46:58 +02:00
Karim shoair
3dc4bdcb4a
docs: small adjustments to the readme file
2026-02-09 00:36:52 +02:00
Karim shoair
2a4d008927
docs: full update for main readme
2026-02-09 00:28:24 +02:00
Karim shoair
1f9eb17414
ops: update benchmarks script
2026-02-08 23:33:30 +02:00
Karim shoair
0c86d70307
docs: update the website main page
2026-02-08 23:33:10 +02:00