04d796b821
v0.4
2026-02-15 07:13:28 +02:00
95ad2842e9
docs: add an entry for the 0.4 version
2026-02-15 04:40:43 +02:00
b19fa5e694
fix(checkpoint): correct error message
2026-02-15 04:36:43 +02:00
e35ba3455c
test: add tests for spiders engine
...
Automated tests written by AI
2026-02-15 04:35:28 +02:00
02b11c535e
fix(spiders): corrections and removal of dead code
2026-02-15 04:25:32 +02:00
b8b9a7f864
docs: general correction across all the pages
...
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00
93bcb1681b
style: docstrings corrections for accuracy
2026-02-15 03:57:14 +02:00
1bf6bb8d65
docs: update the images urls to use main branch
2026-02-15 03:29:57 +02:00
7b8fc911e1
docs: add a page for spiders advanced usage
2026-02-15 02:40:55 +02:00
7b4523af8e
docs: update the titles for all files
2026-02-15 02:35:39 +02:00
c3374bce41
docs: add a note about response body
2026-02-15 01:03:36 +02:00
ba4d33337f
fix: make browser fetchers type hints always present
2026-02-15 01:03:15 +02:00
77e825e7be
docs(spider): add a new page for proxy management & blocking
2026-02-15 01:01:43 +02:00
dee0fd00b8
docs: use more accurate naming for proxy rotation strategy
2026-02-14 23:21:08 +02:00
0ab54852c4
fix: use more accurate naming for proxy rotation strategy
...
It can be considered the simplest form of round robin since we don't have weights or anything (as was originally planned), but let's change it to avoid confusion or useless debates. Here goes nothing
2026-02-14 23:19:54 +02:00
c94ebd2fa9
docs(spiders): add a page to explain sessions logic
2026-02-14 17:19:55 +02:00
108e11fc30
docs: add a new issue template for documentation issues
2026-02-14 17:08:32 +02:00
dddb179c50
docs: add new api references
2026-02-14 17:07:55 +02:00
a8f701f8ab
docs(spiders): add a new page for requests & responses
2026-02-14 04:04:18 +02:00
2997d562d5
test: remove irrelevent test
2026-02-14 03:34:41 +02:00
e785cf26ce
fix(parser)!: Optimize parser for repeated operations
2026-02-14 03:34:13 +02:00
d0a5a01299
test: update spider check
2026-02-14 02:51:39 +02:00
6a0c323482
docs: adding a new Pick Your Path section to the overview page
2026-02-14 00:43:05 +02:00
c6a662eb38
docs(dynamic pages): add an important warning
2026-02-13 18:45:44 +02:00
2eea66dad1
style(spiders): Lower the default number of concurrent requests
2026-02-13 17:32:17 +02:00
a62330d2f1
fix: add typed overloads to Selectors.get() for proper default type inference
...
Type checkers now correctly infer the return type based on the default value:
- .get() → TextHandler | None
- .get("") → TextHandler | str
- .get(0) → TextHandler | int
2026-02-13 17:30:55 +02:00
1c2c7c55bf
docs: use a better looking architecture image instead of mermaid
2026-02-12 15:17:58 +02:00
14143dd0f0
docs: add getting started page to the spiders section
2026-02-12 04:45:39 +02:00
bbb8c26df0
docs: Improve spider architecture page
2026-02-12 04:30:16 +02:00
d0b2cec849
docs: simplify the architecture mermaid
2026-02-12 03:30:14 +02:00
5a599445e2
docs: update libraries
2026-02-12 03:29:41 +02:00
10cd46ee23
docs: add the first page of the spiders section
2026-02-11 03:55:23 +02:00
8902034418
docs: improve wording, style, and use more visual ways
2026-02-11 03:04:35 +02:00
6ac40ac3af
build: adjustments to build file for PyPi
2026-02-11 00:29:20 +02:00
a38f5af615
docs: fix image in the interactive shell page
2026-02-11 00:19:38 +02:00
b52d35c6ec
docs: update beautifulsoup migration guide
2026-02-10 22:13:04 +02:00
8e4b4a22c9
docs: updating extract commans page
2026-02-10 22:09:55 +02:00
7fb57d667c
docs: updating Interactive shell page and some corrections
2026-02-10 22:07:55 +02:00
a72886f158
docs: update camoufox instructions for StealthyFetcher
2026-02-10 21:58:08 +02:00
d4766a070b
build: update the website description
2026-02-10 21:54:17 +02:00
0489923b06
build: pump up the version status
2026-02-10 21:53:00 +02:00
d3ee9a6cbb
ops: remove branch v4 from workflows
2026-02-10 21:51:22 +02:00
2dbd402000
docs: update links to use the current branch
2026-02-10 21:51:02 +02:00
f350800fd7
docs: updating Dynamic websites with protection page and some corrections
2026-02-10 21:48:09 +02:00
dba3e9d53e
docs: updating dynamic websites page and some corrections
2026-02-10 21:23:14 +02:00
8b1704a87e
docs: use better import for ProxyRotator class
2026-02-10 21:20:43 +02:00
4e3829fced
style: expose ProxyRotator class to the public API
2026-02-10 21:20:07 +02:00
8df74dc57b
docs: updating http requests page and some corrections
2026-02-10 19:07:09 +02:00
f25fe64d3c
docs: updating fetcher choosing page and some corrections
2026-02-10 19:01:50 +02:00
87b99a407b
docs: updating adaptive page and some corrections
2026-02-10 19:00:36 +02:00
Karim shoair