a31763afde
fix: replace bare raise with return False in _restore_from_checkpoint
...
When _checkpoint_system_enabled is False, the method uses a bare
`raise` with no active exception, which causes RuntimeError at
runtime. The method's docstring says it returns False when restoration
is not possible, so return False is the correct behavior.
The caller in crawl() currently guards with `if
self._checkpoint_system_enabled`, but the method's own contract
should be self-consistent.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-03-15 17:52:57 +08:00
c7f0db912c
docs: move up a new sponsor
2026-03-14 17:08:51 +02:00
184ba6d0b0
docs: Add Korean (한국어) README translation ( #187 )
2026-03-11 16:49:52 +02:00
60243a823a
docs: Add Korean (한국어) README translation
2026-03-11 14:33:58 +09:00
3836712939
docs: adjustments
2026-03-11 06:13:30 +02:00
50388bf675
docs: update sponsors page
2026-03-11 05:54:54 +02:00
d67a397ecc
docs: add the sponsor to the translated README files
2026-03-11 05:47:32 +02:00
569e317437
docs: add new sponsor
2026-03-11 05:42:18 +02:00
79a03ae7f0
docs: move up a sponsor
2026-03-11 01:11:19 +02:00
1aa150f090
docs: replace the downloads badge
2026-03-11 00:06:05 +02:00
19c21c17ee
v0.4.2 ( #183 )
2026-03-09 01:37:28 +02:00
6ec40ad19d
docs: remove a sponsor
2026-03-09 00:48:15 +02:00
f80743a97b
style: remove unused import
2026-03-09 00:35:06 +02:00
66e0e7af57
fix(agent): update the agent skill zip file with the new version
2026-03-09 00:31:57 +02:00
73832f9dfe
docs: update the website to reflect the google referer logic
2026-03-09 00:29:54 +02:00
d48ac78c79
test: update tests accordingly
2026-03-09 00:28:32 +02:00
8e3bf89e6c
fix(agent): update the agent skills docs and version
2026-03-09 00:27:10 +02:00
a929de6ca4
fix: update code and docstrings to remove the old google referer logic
2026-03-09 00:25:19 +02:00
b547e04207
ops: update playwright pinned version
2026-03-09 00:05:46 +02:00
27409927a3
build: pump up deps and browsers versions
2026-03-08 23:57:10 +02:00
aa6f96eb67
fix: return bare Google URL in referer instead of search query ( #179 )
...
Solves #172
2026-03-08 23:20:43 +02:00
b0c8448f81
Merge branch 'dev' into fix/google-referrer-spoof
2026-03-08 19:01:20 +02:00
11bc08fbaa
fix: Selector.get_all_text() doesn't get all text #167 ( #168 )
...
Fixes #167
2026-03-08 19:01:04 +02:00
68b9e128bc
fix: return bare Google URL in referer instead of search query
...
Real browsers send `https://www.google.com/ ` as the Referer header
when clicking search results, not the full search URL with query
parameters. The previous format was a fingerprinting signal that
the referer was spoofed.
Closes #172
2026-03-08 11:32:04 -04:00
7cbe566acd
Move test for get_all_text to test_parser_advanced.py
2026-03-08 08:20:30 -07:00
e045d0f73f
Merge branch 'dev' into dev
2026-03-08 16:31:25 +02:00
49db2b643b
Merge branch 'main' into dev
2026-03-08 16:27:25 +02:00
b9b5bb0c80
docs: add badges for the agent skill and Clawhub
2026-03-08 06:56:50 +02:00
68e6c3c3e8
docs: adjustments
2026-03-08 06:39:49 +02:00
d1a0b815f5
docs: update translation files with new sponsor
2026-03-08 06:27:04 +02:00
cb7e9b9ef3
docs: add new platinum sponsor
2026-03-08 06:16:48 +02:00
25de97f534
docs: update the agent skill readme
2026-03-08 03:30:04 +02:00
68da2af556
docs: update the agent skill readme
2026-03-08 03:21:23 +02:00
00ad6b4c5f
Add two ignored elements to unit test
2026-03-07 17:11:39 -08:00
5806b8e014
- Add pre-compiled XPath text selector
...
- Avoid recursion
2026-03-07 17:11:39 -08:00
5457a697fa
fix: Selector.get_all_text() doesn't get all text #167
...
- Updated text extraction using recursion
- Added new unit test
2026-03-07 17:11:39 -08:00
54f2c96adf
Merge branch 'main' into dev
2026-03-08 03:06:17 +02:00
f469fb9b8b
feat: Upload the library agent skill
2026-03-08 03:06:01 +02:00
aa3f4b4b0e
docs: remove previous versions pages
...
The Change log page is sufficient.
2026-03-08 02:47:53 +02:00
27db107886
ops: exclude agent skill from workflow triggers
2026-03-08 02:46:54 +02:00
98be98e875
docs: adjustments
2026-03-07 18:57:53 +02:00
cd73d901ab
docs: adjustments
2026-03-07 18:54:29 +02:00
df7ded440c
docs: table adjustments
2026-03-07 18:18:01 +02:00
7089fadf8c
docs: adjustments
2026-03-07 17:59:04 +02:00
685d1fdcc4
docs: move up a sponsor
2026-03-07 17:45:36 +02:00
5215d02666
docs: update website sponsors placement
2026-03-06 16:58:17 +02:00
69c720e710
docs: update ads prices
2026-03-06 16:45:51 +02:00
c8e1d8d75d
fix(type hints): use correct import for Python < 3.12 ( Fixes #163 )
2026-03-05 16:45:10 +02:00
37f5c48a5f
build: pump up the version
...
Co-Authored-By: Christian Rost <chr@baltic-online.de >
2026-03-03 23:09:36 +02:00
1839506622
fix(browsers): make flag concatenation type-safe
...
Better implementation of #157 that's accepted by pyright/mypy.
Thanks to @rostchri .
Co-Authored-By: Christian Rost <chr@baltic-online.de >
2026-03-03 23:08:15 +02:00
haosenwang1018