6a641912cd
docs: add docs for the new features
2026-05-11 02:58:00 +03:00
8a8b2d14ba
test: add tests accordingly
2026-05-11 02:33:43 +03:00
f7da15771b
feat(spiders): Add SitemapSpider
2026-05-11 02:33:37 +03:00
f093d0cf12
feat(spiders): Add CrawlSpider and CrawlRule
2026-05-10 21:13:16 +03:00
18e9121135
feat(spiders): Add pure URL discovery primitive
2026-05-10 21:12:36 +03:00
e5d7ed27fb
Merge branch 'main' into dev
2026-05-09 03:43:58 +03:00
07e0c1c4b9
docs: adding a new sponsor
2026-05-06 17:37:48 +03:00
37c17e8666
docs: adding a new sponsor
2026-05-05 15:38:13 +03:00
333b6de0b5
fix(parser): change the default threshold and add warning
2026-05-02 19:58:53 +03:00
ea7b4bddd3
Merge branch 'main' into dev
2026-04-30 19:21:46 +03:00
a2285436e1
docs: adding a new sponsor
2026-04-30 19:20:25 +03:00
90a853d0fd
fix(request fp): hash request kwargs and headers correctly ( #255 )
2026-04-30 18:54:16 +03:00
809d4782ba
Merge branch 'dev' into fix/request-fingerprint
2026-04-30 18:45:25 +03:00
334b0f5538
fix: str(value)
2026-04-30 09:52:34 -04:00
f305580f1d
Merge branch 'main' into dev
2026-04-30 16:25:35 +03:00
be9f12f05a
docs: adding a new sponsor
2026-04-30 16:24:44 +03:00
756a59516b
Merge branch 'main' into dev
2026-04-28 23:31:47 +03:00
984b90da65
docs: moving up a sponsor
2026-04-28 23:29:45 +03:00
a5a5652996
test: add request fingerprint regressions
2026-04-26 16:31:58 -04:00
b17363502d
fix: hash request kwargs and headers correctly
2026-04-25 22:13:38 -04:00
835e7ca8c3
docs: update old examples
2026-04-26 02:46:13 +03:00
82837ee11f
Merge branch 'main' into dev
2026-04-25 20:34:39 +03:00
fa41ca6fa9
docs: Updating deps and allow code copy
2026-04-25 20:34:33 +03:00
19d4bff427
docs: remove segment left by mistake
2026-04-24 22:00:09 +03:00
fb6ac7e167
docs: readd a sponsor
2026-04-24 21:58:15 +03:00
b6f0f2a7f2
build: pump up version and deps
2026-04-22 17:01:11 +02:00
9af644ef84
docs: improving the code copy-paste experience and use less tokens for the agent skill
2026-04-22 16:52:59 +02:00
b626b4d585
test: adding new tests for the configure function
2026-04-22 15:35:15 +02:00
35032d6f5f
fix: solving a bug with using configure on Fetcher
2026-04-22 15:31:18 +02:00
54a080aae1
v0.4.7 ( #251 )
2026-04-17 23:09:43 +02:00
2a1e9e22f2
docs(agent): update skill with the latest changes
2026-04-17 22:51:50 +02:00
77b29a3ebe
docs: update with the latest changes
2026-04-17 22:51:20 +02:00
78e388f75c
feat: add new mcp tool to screenshot pages
...
Implements #244
2026-04-17 22:07:44 +02:00
9619c64fd8
fix(static): exclude block_ads from HTTP session request args ( #249 )
2026-04-17 20:47:52 +02:00
65421f0a16
Merge branch 'dev' into fix/block-ads-unexpected-kwarg
2026-04-17 20:45:00 +02:00
07bbb37bce
docs: Add Brazilian Portuguese translation ( #250 )
2026-04-17 20:36:29 +02:00
3565318100
Merge branch 'dev' into main
2026-04-17 20:33:26 +02:00
df0531d326
Merge branch 'main' into dev
2026-04-17 20:33:04 +02:00
42663dcba1
Merge branch 'dev' into main
2026-04-17 20:31:43 +02:00
689c79e7d3
fix: prevent FetcherSession state corruption and lazy session close crash ( #245 )
2026-04-17 20:27:48 +02:00
6b51b977e7
Merge branch 'main' into main
2026-04-17 20:25:10 +02:00
11e038768b
docs: removing a sponsor
2026-04-17 19:24:06 +02:00
bb90e0a83e
Add pt-BR README link to language selector
2026-04-16 14:43:48 -03:00
d60d7438a5
docs: removing a sponsor
2026-04-16 17:01:21 +02:00
76ba28efaa
fix(static): exclude block_ads from HTTP request args
...
block_ads is a browser-engine parameter (used by PlayWright/Camoufox
fetchers for ad-domain blocking) and is not recognised by curl_cffi's
Session.request(). When the CLI's --ai-targeted flag sets block_ads=True,
_merge_request_args forwards it unfiltered, causing:
TypeError: Session.request() got an unexpected keyword argument 'block_ads'
Add block_ads to the skip_keys set so it is stripped before the dict
reaches Session.request(), consistent with existing entries for
extra_headers and google_search.
Fixes #247
2026-04-16 13:10:59 +00:00
62b95a047d
Merge branch 'dev' into fix/fetcher-session-state-corruption
2026-04-15 21:51:26 -04:00
f4186ab998
fix: prevent FetcherSession state corruption and lazy session close crash
2026-04-15 21:48:24 -04:00
614d136f8c
build: pump up version and deps
2026-04-15 20:44:38 +02:00
f8ec79833f
feat(mcp): add optional session_id parameter to open_session ( #243 )
2026-04-15 02:37:11 +02:00
00897dad2f
feat(mcp): add optional session_id parameter to open_session
...
Allow users to specify a custom session_id when opening a browser session,
rather than always generating a random UUID. Useful for naming sessions
for easier management across multiple tool calls.
- Add session_id: Optional[str] = None parameter
- Validate session_id doesn't already exist before starting browser
- Fall back to uuid4().hex[:12] if not provided
- Add tests for custom session_id and duplicate detection
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com >
2026-04-14 01:17:52 -04:00
Karim shoair