 Karim shoair
|
17ea982162
|
fix(fetchers): add max retry limit to _get_page_content to prevent infinite loop (#197)
|
2026-03-17 22:09:05 +02:00 |
|
|
Karim shoair
|
8e4e59e13e
|
Merge branch 'dev' into fix/page-content-infinite-loop
|
2026-03-17 22:08:47 +02:00 |
|
|
Karim shoair
|
d9932f2308
|
fix(spider/fetcher): preserve HTTP method across retries in spider session (#201)
|
2026-03-17 22:06:01 +02:00 |
|
|
Karim shoair
|
4c07b294ae
|
Merge branch 'dev' into fix/preserve-http-method-on-retry
|
2026-03-17 22:04:57 +02:00 |
|
|
Karim shoair
|
27f306259e
|
Merge branch 'dev' into fix/page-content-infinite-loop
|
2026-03-17 21:55:26 +02:00 |
|
|
Karim shoair
|
136c389787
|
fix(Texthandler): Replace get_all with getall to match the Selector class
|
2026-03-17 21:53:17 +02:00 |
|
|
Karim shoair
|
980be18a2a
|
test: add coverage for TextHandler regex paths and TextHandlers.re() (#194)
|
2026-03-17 21:50:05 +02:00 |
|
|
Karim shoair
|
5123590a15
|
Merge branch 'dev' into test/custom-types-coverage
|
2026-03-17 21:42:17 +02:00 |
|
|
Karim shoair
|
cc6c0dbfb9
|
fix: adjust test to the _restore_from_checkpoint fix
|
2026-03-17 17:46:47 +02:00 |
|
|
Karim shoair
|
1fb7961d42
|
fix: replace bare raise with return False in _restore_from_checkpoint (#196)
|
2026-03-17 17:45:52 +02:00 |
|
|
Karim shoair
|
bcd45e47bb
|
Merge branch 'dev' into fix/checkpoint-restore-bare-raise
|
2026-03-17 17:36:11 +02:00 |
|
|
Karim shoair
|
5eefbc6c05
|
Merge branch 'dev' into test/custom-types-coverage
|
2026-03-17 17:34:12 +02:00 |
|
|
Karim shoair
|
440da11259
|
Merge branch 'main' into dev
|
2026-03-17 17:28:38 +02:00 |
|
|
Karim shoair
|
7bfaf204b7
|
docs: CJK Latin spacing fixes for the JP README
|
2026-03-17 17:12:41 +02:00 |
|
|
Karim shoair
|
74abd54a0b
|
docs: Add translations to the new sponsor
|
2026-03-17 17:00:32 +02:00 |
|
|
Karim shoair
|
3d60792cbc
|
docs: update Zensical
|
2026-03-17 16:53:55 +02:00 |
|
|
Karim shoair
|
3b543a6bdd
|
docs: add a new sponsor
|
2026-03-17 16:45:04 +02:00 |
|
|
Karim shoair
|
012e9f9f5e
|
docs: images adjustments
|
2026-03-16 16:23:08 +02:00 |
|
|
Karim shoair
|
f25bca75bf
|
docs: fixing broken links
Also, Fixes #199
|
2026-03-16 15:38:23 +02:00 |
|
|
Karim shoair
|
ca6c1f3c1e
|
docs: CJK Latin spacing fixes for the Chinese README
|
2026-03-16 15:26:25 +02:00 |
|
|
Karim shoair
|
72a2c8de81
|
Merge branch 'main' into dev
|
2026-03-15 22:44:16 +02:00 |
|
|
Karim shoair
|
eb32285c49
|
docs: add the sponsor translated versions
|
2026-03-15 22:25:50 +02:00 |
|
|
Karim shoair
|
f286575f31
|
docs: adding a new sponsor
|
2026-03-15 22:17:12 +02:00 |
|
|
Karim shoair
|
1e7704864e
|
Merge branch 'dev' into test/custom-types-coverage
|
2026-03-15 16:38:48 +02:00 |
|
|
Karim shoair
|
e63e57e6dc
|
test(ai): add _normalize_credentials edge case coverage (#192)
|
2026-03-15 16:25:57 +02:00 |
|
|
Karim shoair
|
656dbc7d12
|
Merge branch 'dev' into test/normalize-credentials-coverage
|
2026-03-15 16:24:59 +02:00 |
|
|
Karim shoair
|
c7f0db912c
|
docs: move up a new sponsor
|
2026-03-14 17:08:51 +02:00 |
|
|
Karim shoair
|
184ba6d0b0
|
docs: Add Korean (한국어) README translation (#187)
|
2026-03-11 16:49:52 +02:00 |
|
|
Karim shoair
|
3836712939
|
docs: adjustments
|
2026-03-11 06:13:30 +02:00 |
|
|
Karim shoair
|
50388bf675
|
docs: update sponsors page
|
2026-03-11 05:54:54 +02:00 |
|
|
Karim shoair
|
d67a397ecc
|
docs: add the sponsor to the translated README files
|
2026-03-11 05:47:32 +02:00 |
|
|
Karim shoair
|
569e317437
|
docs: add new sponsor
|
2026-03-11 05:42:18 +02:00 |
|
|
Karim shoair
|
79a03ae7f0
|
docs: move up a sponsor
|
2026-03-11 01:11:19 +02:00 |
|
|
Karim shoair
|
1aa150f090
|
docs: replace the downloads badge
|
2026-03-11 00:06:05 +02:00 |
|
|
Karim shoair
|
19c21c17ee
|
v0.4.2 (#183)
|
2026-03-09 01:37:28 +02:00 |
|
|
Karim shoair
|
6ec40ad19d
|
docs: remove a sponsor
|
2026-03-09 00:48:15 +02:00 |
|
|
Karim shoair
|
f80743a97b
|
style: remove unused import
|
2026-03-09 00:35:06 +02:00 |
|
|
Karim shoair
|
66e0e7af57
|
fix(agent): update the agent skill zip file with the new version
|
2026-03-09 00:31:57 +02:00 |
|
|
Karim shoair
|
73832f9dfe
|
docs: update the website to reflect the google referer logic
|
2026-03-09 00:29:54 +02:00 |
|
|
Karim shoair
|
d48ac78c79
|
test: update tests accordingly
|
2026-03-09 00:28:32 +02:00 |
|
|
Karim shoair
|
8e3bf89e6c
|
fix(agent): update the agent skills docs and version
|
2026-03-09 00:27:10 +02:00 |
|
|
Karim shoair
|
a929de6ca4
|
fix: update code and docstrings to remove the old google referer logic
|
2026-03-09 00:25:19 +02:00 |
|
|
Karim shoair
|
b547e04207
|
ops: update playwright pinned version
|
2026-03-09 00:05:46 +02:00 |
|
|
Karim shoair
|
27409927a3
|
build: pump up deps and browsers versions
|
2026-03-08 23:57:10 +02:00 |
|
|
Karim shoair
|
aa6f96eb67
|
fix: return bare Google URL in referer instead of search query (#179)
Solves #172
|
2026-03-08 23:20:43 +02:00 |
|
|
Karim shoair
|
b0c8448f81
|
Merge branch 'dev' into fix/google-referrer-spoof
|
2026-03-08 19:01:20 +02:00 |
|
|
Karim shoair
|
11bc08fbaa
|
fix: Selector.get_all_text() doesn't get all text #167 (#168)
Fixes #167
|
2026-03-08 19:01:04 +02:00 |
|
|
Karim shoair
|
e045d0f73f
|
Merge branch 'dev' into dev
|
2026-03-08 16:31:25 +02:00 |
|
|
Karim shoair
|
49db2b643b
|
Merge branch 'main' into dev
|
2026-03-08 16:27:25 +02:00 |
|
|
Karim shoair
|
b9b5bb0c80
|
docs: add badges for the agent skill and Clawhub
|
2026-03-08 06:56:50 +02:00 |
|
|
Karim shoair
|
68e6c3c3e8
|
docs: adjustments
|
2026-03-08 06:39:49 +02:00 |
|
|
Karim shoair
|
d1a0b815f5
|
docs: update translation files with new sponsor
|
2026-03-08 06:27:04 +02:00 |
|
|
Karim shoair
|
cb7e9b9ef3
|
docs: add new platinum sponsor
|
2026-03-08 06:16:48 +02:00 |
|
|
Karim shoair
|
25de97f534
|
docs: update the agent skill readme
|
2026-03-08 03:30:04 +02:00 |
|
|
Karim shoair
|
68da2af556
|
docs: update the agent skill readme
|
2026-03-08 03:21:23 +02:00 |
|
|
Karim shoair
|
54f2c96adf
|
Merge branch 'main' into dev
|
2026-03-08 03:06:17 +02:00 |
|
|
Karim shoair
|
f469fb9b8b
|
feat: Upload the library agent skill
|
2026-03-08 03:06:01 +02:00 |
|
|
Karim shoair
|
aa3f4b4b0e
|
docs: remove previous versions pages
The Change log page is sufficient.
|
2026-03-08 02:47:53 +02:00 |
|
|
Karim shoair
|
27db107886
|
ops: exclude agent skill from workflow triggers
|
2026-03-08 02:46:54 +02:00 |
|
|
Karim shoair
|
98be98e875
|
docs: adjustments
|
2026-03-07 18:57:53 +02:00 |
|
|
Karim shoair
|
cd73d901ab
|
docs: adjustments
|
2026-03-07 18:54:29 +02:00 |
|
|
Karim shoair
|
df7ded440c
|
docs: table adjustments
|
2026-03-07 18:18:01 +02:00 |
|
|
Karim shoair
|
7089fadf8c
|
docs: adjustments
|
2026-03-07 17:59:04 +02:00 |
|
|
Karim shoair
|
685d1fdcc4
|
docs: move up a sponsor
|
2026-03-07 17:45:36 +02:00 |
|
|
Karim shoair
|
5215d02666
|
docs: update website sponsors placement
|
2026-03-06 16:58:17 +02:00 |
|
|
Karim shoair
|
69c720e710
|
docs: update ads prices
|
2026-03-06 16:45:51 +02:00 |
|
|
Karim shoair
|
c8e1d8d75d
|
fix(type hints): use correct import for Python < 3.12 (Fixes #163 )
|
2026-03-05 16:45:10 +02:00 |
|
|
Karim shoairandChristian Rost
|
37f5c48a5f
|
build: pump up the version
Co-Authored-By: Christian Rost <chr@baltic-online.de>
|
2026-03-03 23:09:36 +02:00 |
|
|
Karim shoairandChristian Rost
|
1839506622
|
fix(browsers): make flag concatenation type-safe
Better implementation of #157 that's accepted by pyright/mypy.
Thanks to @rostchri .
Co-Authored-By: Christian Rost <chr@baltic-online.de>
|
2026-03-03 23:08:15 +02:00 |
|
|
Karim shoair
|
1142c4bf27
|
Merge branch 'main' into dev
|
2026-03-03 23:02:23 +02:00 |
|
|
Karim shoair
|
bcdfba4d07
|
docs: add French language to the translated README files
|
2026-03-03 21:26:05 +02:00 |
|
|
Karim shoair
|
b40a1a37b9
|
docs: add a new special sponsor
|
2026-03-03 21:17:13 +02:00 |
|
|
Karim shoair
|
efe2c89a20
|
Merge branch 'main' into dev
|
2026-03-03 14:19:10 +02:00 |
|
|
Karim shoair
|
bf79102951
|
docs: sponsors field adjustment
Removed unnecessary line breaks in the description.
|
2026-03-03 14:18:44 +02:00 |
|
|
Karim shoair
|
45a03cf3e3
|
Merge branch 'main' into dev
|
2026-03-03 03:16:19 +02:00 |
|
|
Karim shoair
|
5ddcfa1073
|
docs: add new platinum sponsor
|
2026-03-03 00:24:46 +02:00 |
|
|
Karim shoair
|
f86fa1aad5
|
docs: add new sponsor image
|
2026-03-03 00:08:30 +02:00 |
|
|
Karim shoair
|
9bb605c814
|
Merge branch 'main' into dev
|
2026-03-02 22:37:35 +02:00 |
|
|
Karim shoair
|
4ba93d78ac
|
docs: updates to the sponsorship plans
|
2026-03-02 17:44:20 +02:00 |
|
|
Karim shoair
|
08ffa7a9d7
|
docs: updates to the sponsorship plans
|
2026-03-02 17:38:40 +02:00 |
|
|
Karim shoair
|
5db4c96681
|
docs: update a sponsor status
|
2026-03-02 17:32:00 +02:00 |
|
|
Karim shoair
|
e04d59bd79
|
docs: update a sponsor status
|
2026-03-02 17:31:14 +02:00 |
|
|
Karim shoair
|
0af4fa24a6
|
docs: add a citations section
|
2026-02-28 17:03:05 +02:00 |
|
|
Karim shoair
|
b9fa6b62e6
|
docs: make the contribution rules clearer
|
2026-02-28 16:57:41 +02:00 |
|
|
Karim shoair
|
50a69c3583
|
ops: update workflows triggers
and pinning playwright version here too
|
2026-02-28 16:45:26 +02:00 |
|
|
Karim shoair
|
69f916d694
|
docs: Enhance CONTRIBUTING rules with PR guidelines and updates
Added guidelines for making pull requests and updated documentation on building and testing.
|
2026-02-28 16:41:44 +02:00 |
|
|
Karim shoair
|
2206d052fd
|
docs: update a sponsor url
|
2026-02-28 02:25:15 +02:00 |
|
|
Karim shoair
|
1f53620623
|
docs: remove a sponsor
|
2026-02-27 14:59:43 +02:00 |
|
|
Karim shoair
|
bbdc4cec5d
|
ops: add the mcp server to the docker file
|
2026-02-27 06:20:05 +02:00 |
|
|
Karim shoair
|
2b50123fa6
|
v0.4.1 (#154)
|
2026-02-27 06:12:45 +02:00 |
|
|
Karim shoair
|
d0cc6e5a3d
|
ops: pump mcp server version up
|
2026-02-27 04:52:16 +02:00 |
|
|
Karim shoair
|
e34651d887
|
fix(stealth): improve stealth mode by removing unnecessary scripts
It doesn't add anything to the table as before (it might turn out I was wrong and add them again lol)
|
2026-02-27 03:50:14 +02:00 |
|
|
Karim shoair
|
b50e8f050f
|
fix(mcp): make mcp use less tokens by striping useless tags
|
2026-02-27 03:39:48 +02:00 |
|
|
Karim shoair
|
d750fec468
|
fix(solver): Solve CF faster and handle websites that show captcha twice
|
2026-02-27 02:32:21 +02:00 |
|
|
Karim shoair
|
ef29568cd0
|
docs: add a code snippet on how to do scrapling install from code
|
2026-02-27 01:17:54 +02:00 |
|
|
Karim shoair
|
5f885ae5f5
|
docs(mcp): update cursor url
|
2026-02-27 01:03:56 +02:00 |
|
|
Karim shoair
|
efb320bb8c
|
docs: style adjustments
|
2026-02-27 00:49:00 +02:00 |
|
|
Karim shoair
|
a8359a4878
|
build: pump version up and the deps
|
2026-02-27 00:32:25 +02:00 |
|
|
Karim shoair
|
921314c314
|
fix: complete MCP schema validation for remaining bare array types
- Fix params (Dict|List|Tuple → Dict), urls (Tuple[str,...] → List[str]),
- Renamed _NormalizeCredentials/_ContentTranslator to snake_case.
- Also, raise a ValueError on invalid credentials instead of returning None silently.
|
2026-02-27 00:28:44 +02:00 |
|
|
Karim shoair
|
86e0f0f250
|
docs: update deps for the website
|
2026-02-27 00:11:02 +02:00 |
|