f0db3d7d14
fix(spiders): use os.replace for atomic checkpoint/cache writes on Windows
...
CheckpointManager.save() and ResponseCacheManager.put() write to a temp
file and then move it into place with Path.rename(). On Windows, os.rename
cannot overwrite an existing destination and raises FileExistsError
(WinError 183), so every write after the first one fails: checkpoint
saving raises and breaks resume, while the development response cache
swallows the error and keeps returning the stale entry.
Path.replace() (os.replace) overwrites the destination atomically on every
platform and behaves identically to rename() on POSIX, so this is a no-op
on Linux and macOS and only fixes the broken overwrite on Windows.
Add a regression test for the cache overwrite path; the checkpoint
overwrite is already covered by test_multiple_saves_overwrite.
2026-06-07 04:24:12 +03:00
53ef32c723
docs: fix Docker image name in remaining examples ( #315 )
2026-06-02 02:19:27 +03:00
6efd50dd17
Merge branch 'dev' into docs/fix-docker-image-name-sweep
2026-06-02 02:17:22 +03:00
464fba2435
docs: remove a sponsor
2026-06-02 01:39:06 +03:00
9e43062a63
docs: use pyd4vinci/scrapling in remaining Docker examples ( #282 )
...
PR #283 fixed the bare `scrapling` image name in docs/ai/mcp-server.md;
the agent-skill MCP reference and CLI extract docs still used the
unqualified name, which Docker resolves against the official library
namespace and fails with pull access denied.
2026-06-01 09:30:21 +09:00
a6a57eee44
docs: update a sponsor
2026-05-30 15:37:08 +03:00
961f659ac8
docs: remove old sponsors
2026-05-30 15:30:05 +03:00
dbd48ffd60
docs: add a new sponsor
2026-05-28 00:53:54 +03:00
b31dc50a06
docs: remove an old sponsor
2026-05-27 04:10:38 +03:00
ed008efcf7
docs: updating a sponsor image
2026-05-18 19:33:49 +03:00
735af8f221
docs: fix Docker image name in MCP example ( #283 )
2026-05-16 03:42:13 +03:00
b5d7d3d103
Merge branch 'main' into fix/mcp-docker-image-name
2026-05-16 03:41:48 +03:00
b227583e5f
docs: fix Docker image name in MCP example
2026-05-15 09:35:04 -04:00
6380ef0f26
docs: adding a new sponsor
2026-05-11 15:41:27 +03:00
9ee35014fe
v0.4.8 ( #277 )
2026-05-11 04:59:43 +03:00
66d8917013
ops: update tests deps
2026-05-11 04:37:18 +03:00
149d5f0923
Merge branch 'main' into dev
2026-05-11 04:28:34 +03:00
55931897d6
docs(agent): update skill zip file
2026-05-11 03:34:17 +03:00
34651abc6b
tests: remove old code and update the rest
2026-05-11 03:30:59 +03:00
ebd7e0971c
build: update deps and browser useragents
2026-05-11 03:18:26 +03:00
c0ed8949f6
docs: update zensical version
2026-05-11 03:00:11 +03:00
6a641912cd
docs: add docs for the new features
2026-05-11 02:58:00 +03:00
8a8b2d14ba
test: add tests accordingly
2026-05-11 02:33:43 +03:00
f7da15771b
feat(spiders): Add SitemapSpider
2026-05-11 02:33:37 +03:00
f093d0cf12
feat(spiders): Add CrawlSpider and CrawlRule
2026-05-10 21:13:16 +03:00
18e9121135
feat(spiders): Add pure URL discovery primitive
2026-05-10 21:12:36 +03:00
940036fa8f
docs: removing a sponsor
2026-05-10 15:49:54 +03:00
e5d7ed27fb
Merge branch 'main' into dev
2026-05-09 03:43:58 +03:00
07e0c1c4b9
docs: adding a new sponsor
2026-05-06 17:37:48 +03:00
37c17e8666
docs: adding a new sponsor
2026-05-05 15:38:13 +03:00
333b6de0b5
fix(parser): change the default threshold and add warning
2026-05-02 19:58:53 +03:00
ea7b4bddd3
Merge branch 'main' into dev
2026-04-30 19:21:46 +03:00
a2285436e1
docs: adding a new sponsor
2026-04-30 19:20:25 +03:00
90a853d0fd
fix(request fp): hash request kwargs and headers correctly ( #255 )
2026-04-30 18:54:16 +03:00
809d4782ba
Merge branch 'dev' into fix/request-fingerprint
2026-04-30 18:45:25 +03:00
334b0f5538
fix: str(value)
2026-04-30 09:52:34 -04:00
f305580f1d
Merge branch 'main' into dev
2026-04-30 16:25:35 +03:00
be9f12f05a
docs: adding a new sponsor
2026-04-30 16:24:44 +03:00
756a59516b
Merge branch 'main' into dev
2026-04-28 23:31:47 +03:00
984b90da65
docs: moving up a sponsor
2026-04-28 23:29:45 +03:00
a5a5652996
test: add request fingerprint regressions
2026-04-26 16:31:58 -04:00
b17363502d
fix: hash request kwargs and headers correctly
2026-04-25 22:13:38 -04:00
835e7ca8c3
docs: update old examples
2026-04-26 02:46:13 +03:00
82837ee11f
Merge branch 'main' into dev
2026-04-25 20:34:39 +03:00
fa41ca6fa9
docs: Updating deps and allow code copy
2026-04-25 20:34:33 +03:00
19d4bff427
docs: remove segment left by mistake
2026-04-24 22:00:09 +03:00
fb6ac7e167
docs: readd a sponsor
2026-04-24 21:58:15 +03:00
b6f0f2a7f2
build: pump up version and deps
2026-04-22 17:01:11 +02:00
9af644ef84
docs: improving the code copy-paste experience and use less tokens for the agent skill
2026-04-22 16:52:59 +02:00
b626b4d585
test: adding new tests for the configure function
2026-04-22 15:35:15 +02:00
Ahmed Elshahat