Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• f8ec79833f feat(mcp): add optional session_id parameter to open_session (#243) Karim shoair 2026-04-15 02:37:11 +02:00
• 00897dad2f feat(mcp): add optional session_id parameter to open_session Jules Omlor 2026-04-14 01:17:52 -04:00
• ced9a8d63c v0.4.6 (#242) Karim shoair 2026-04-13 15:36:33 +02:00
• 65c54f3b91 fix: duplicate ID segments in full-path selector generation (#241) Karim shoair 2026-04-13 12:04:20 +02:00
• 3c23436448 Merge branch 'dev' into fix/full-path-selector-duplicate-id Karim shoair 2026-04-13 12:03:15 +02:00
• c2e66ab753 docs(agent): update skill with the latest changes Karim shoair 2026-04-13 04:39:01 +02:00
• 158ff04c96 docs: add the new page_setup feature Karim shoair 2026-04-13 04:38:23 +02:00
• 5e13d3ece6 feat(browsers): add a pre-navigation hook to allow page setup Karim shoair 2026-04-13 03:57:27 +02:00
• d19e861e45 fix: correct Seconds type alias to accept float values Karim shoair 2026-04-13 01:08:53 +02:00
• d4c36ea125 Merge branch 'main' into dev Karim shoair 2026-04-12 20:42:19 +02:00
• 4279ca8cbc docs(agent): update skill with the latest changes Karim shoair 2026-04-12 18:47:26 +02:00
• 887eeee4c2 build: pump up version and deps Karim shoair 2026-04-12 18:47:13 +02:00
• 9a7fb0b426 docs: adding the new features and updating the translated pages Karim shoair 2026-04-12 18:20:56 +02:00
• ad6fd52845 perf: force ad blocking on the MCP server and when the AI mode is activated on CLI Karim shoair 2026-04-12 18:11:02 +02:00
• 131b729f22 docs: adding the new features Karim shoair 2026-04-12 18:07:38 +02:00
• be28fe16ec feat(browsers): add new feature to enable DNS-over-HTTP to prevent DNS leaks Karim shoair 2026-04-12 18:03:03 +02:00
• 0678ed1406 fix(shell): add missing parameters to the shell signature Karim shoair 2026-04-12 18:00:41 +02:00
• d952db8ef8 feat(browsers): add a new feature to block ads Karim shoair 2026-04-12 17:59:00 +02:00
• 273c8c2fa0 fix: emit valid XPath node test for ID elements in full-path mode sjhddh 2026-04-12 09:46:55 +02:00
• 1ac26733d8 fix: prevent duplicate ID segments in full-path selector generation sjhddh 2026-04-12 01:25:45 +02:00
• 2046527575 docs: adding a new sponsor Karim shoair 2026-04-08 13:30:00 +02:00
• e5c5e7f50c docs: adding new sponsor Karim shoair 2026-04-08 13:24:43 +02:00
• cb449afc81 v0.4.5 (#235) Karim shoair 2026-04-07 06:21:55 +02:00
• 664e419751 docs(agent): update skill with the latest changes Karim shoair 2026-04-07 05:39:39 +02:00
• 88d0459cd2 docs: adding the new development mode Karim shoair 2026-04-07 05:30:51 +02:00
• fc6a0345a8 Merge branch 'main' into dev Karim shoair 2026-04-07 05:09:06 +02:00
• aee6888dd5 docs: remove an old sponsor Karim shoair 2026-04-07 05:08:45 +02:00
• d1baf1fc46 feat(spiders): add a development mode Karim shoair 2026-04-07 04:08:54 +02:00
• fad9efdc35 fix(spider): save checkpoint before cancel_scope.cancel() on force-stop to prevent data loss (#230) Karim shoair 2026-04-05 22:07:56 +02:00
• 9950dde724 test: align force-stop regression stubs with dev branch d 🔹 2026-04-05 19:13:19 +00:00
• eaa0e8cae6 fix: save checkpoint before cancel_scope.cancel() on force-stop to prevent data loss voidborne-d 2026-04-03 07:05:32 +00:00
• a61113fc29 docs(agent): update skill with the latest changes Karim shoair 2026-04-05 19:42:00 +02:00
• d0a19a6fe1 build: pump version up Karim shoair 2026-04-05 19:41:10 +02:00
• f756e519f3 docs: update pages with the new changes Karim shoair 2026-04-05 19:40:05 +02:00
• e7f9adb40a feat(security): default follow_redirects to "safe" for SSRF protection Karim shoair 2026-04-05 18:41:50 +02:00
• 065bf1c0e8 v0.4.4 (#229) Karim shoair 2026-04-05 05:37:08 +02:00
• 087634ab67 docs: updated the translated files Karim shoair 2026-04-05 05:28:57 +02:00
• 4c3ff2f0f1 docs: updating pages with the new feature Karim shoair 2026-04-05 05:27:07 +02:00
• c54081ff1a docs(agent): update skill with the latest changes Karim shoair 2026-04-05 05:26:34 +02:00
• 9383bec14e style(spider): removing excessive docstrings and unifying the style with the rest of the repo Karim shoair 2026-04-05 03:43:21 +02:00
• 070338cf24 fix(spider): only allocate _domain_delays when robots_txt_obey is enabled Karim shoair 2026-04-05 02:36:15 +02:00
• 911d3af632 build: pumping up protego minimum version Karim shoair 2026-04-05 02:33:15 +02:00
• afaf68e7d5 fix(spider robots): removing dead code Karim shoair 2026-04-05 02:32:33 +02:00
• ea2dd7866b refactor(spiders): Make Robots.txt compliance turned off by default Karim shoair 2026-04-05 01:55:17 +02:00
• 556a90f645 refactor(spider): prefetch robots.txt from start_urls only Karim shoair 2026-04-05 01:43:06 +02:00
• ec487d37e8 fix(spider): Make delay in robots file don't affect user's concurrency settings Karim shoair 2026-04-05 01:39:05 +02:00
• af83a11aa7 fix(spider robots): solve multiple issues with cache prefetch Karim shoair 2026-04-05 00:09:17 +02:00
• 854daac794 style(spiders robots feat): Adjustments for maintainability Karim shoair 2026-04-04 21:06:35 +02:00
• acb49b178c Merge branch 'main' into dev Karim shoair 2026-04-04 16:46:10 +02:00
• 2b6251d485 feat(spiders): robots.txt compliance (#226) Karim shoair 2026-04-04 16:45:27 +02:00
• fcf930c568 docs: Adding a new sponsor Karim shoair 2026-04-04 13:03:57 +02:00
• a134fdb8cc feat(spiders): enable robots.txt compliance by default Abdullah 2026-04-04 03:10:17 +02:00
• a86e9709ea feat(spiders): pre-warm robots.txt cache before crawl loop starts Abdullah 2026-04-04 03:00:15 +02:00
• e2b293f41c refactor(spiders): simplify robots.txt cache to domain-only key Abdullah 2026-04-04 03:00:15 +02:00
• 07129ce4b1 feat(deps): move protego to fetchers optional dependency Abdullah 2026-04-03 17:51:00 +02:00
• a2bf00c995 Merge branch 'D4Vinci:dev' into dev Abdullah 2026-04-03 17:38:28 +02:00
• eaf7ec2cc0 fix(requests): handle missing type hint returned by curl-cffi Karim shoair 2026-04-03 17:26:52 +02:00
• 9dcfe47da7 build: pump up deps Karim shoair 2026-04-03 17:18:15 +02:00
• 132f33c846 test(spiders): add comprehensive test suite for robots.txt compliance Abdullah 2026-04-03 15:08:34 +02:00
• 5c40c6a853 feat(spiders): integrate robots.txt compliance into the crawl engine Abdullah 2026-04-03 15:08:33 +02:00
• 0bbe62fc7f feat(spiders): implement RobotsTxtManager with concurrent fetch deduplication Abdullah 2026-04-03 15:08:33 +02:00
• 1d15349e07 feat(deps): add protego for robots.txt parsing and fix pyright type error in static.py Abdullah 2026-04-03 15:08:33 +02:00
• cb93c15c5a Merge branch 'main' into dev Karim shoair 2026-04-02 18:14:51 +02:00
• 636612e894 fix: proxy rotation page pool leak (#223) Karim shoair 2026-04-02 18:04:02 +02:00
• 6c6aabeb73 fix: proxy rotation page pool leak yetval 2026-04-02 11:57:17 -04:00
• 11f238bb63 docs: fix Karim shoair 2026-04-02 16:39:37 +02:00
• f48418abbc docs: adding a new sponsor Karim shoair 2026-04-02 16:35:43 +02:00
• 966e17a1dc build: pump version up Karim shoair 2026-04-01 17:38:54 +02:00
• f614651a97 fix(Proxy Rotation): Fix an MRO issue Karim shoair 2026-04-01 17:36:35 +02:00
• e173f813da v0.4.3 (#217) Karim shoair 2026-03-30 05:50:45 +02:00
• b354be06c0 fix(agent): update skill zip file with the latest changes Karim shoair 2026-03-30 03:54:28 +02:00
• a403156b2e docs: style adjustment Karim shoair 2026-03-30 03:53:56 +02:00
• 1f1e475772 docs: add the browser path to docs Karim shoair 2026-03-30 03:37:38 +02:00
• 8a4c5ffa3b feat(browsers): Add a new option to set browser path Karim shoair 2026-03-30 03:06:58 +02:00
• 6598664f55 fix(agent): update skill zip file with the latest changes Karim shoair 2026-03-30 02:55:05 +02:00
• 3ac7f76f9b docs(mcp): add section about prompt injection in docs and skill Karim shoair 2026-03-30 02:54:05 +02:00
• 786093ff36 docs: update pages and skill with the new commandline option Karim shoair 2026-03-30 02:49:32 +02:00
• 4efbffa1dc feat(cli): Add an option to make content safe/targets AI Karim shoair 2026-03-30 02:44:14 +02:00
• 375951bd49 feat(mcp): Protect from Prompt Injection by removing hidden content Karim shoair 2026-03-30 02:31:14 +02:00
• bcd39d57c0 docs: update the agent skill with the new features Karim shoair 2026-03-29 23:46:25 +02:00
• 7f552bed73 docs: Add docs for the new MCP tools Karim shoair 2026-03-29 23:38:54 +02:00
• 8e89a73014 build(docs): Pump up Zensical version to the latest Karim shoair 2026-03-29 23:14:52 +02:00
• 61cda587be docs: update pages with the XHR feature Karim shoair 2026-03-29 23:12:56 +02:00
• 5c450a3b52 fix: improve type hints for the static checkers Karim shoair 2026-03-29 23:01:02 +02:00
• 68f7c5c36f feat(browser sessions): Collect XHR requests done while loading the page Karim shoair 2026-03-29 22:53:54 +02:00
• 0f6dcccf5f fix(mcp): remove unneeded code and fix type hint for mypy Karim shoair 2026-03-28 17:19:42 +02:00
• c458ab65a2 feat(mcp): Add three new tools to control browser sessions Karim shoair 2026-03-28 00:16:14 +02:00
• a356dd2f2b refactor(mcp)!: Cleaning and unifying functions to async Karim shoair 2026-03-27 19:30:58 +02:00
• 8e147db7f8 refactor(cli): Code cleaning for easier maintenance/adding new features Karim shoair 2026-03-27 18:02:33 +02:00
• d47599f204 Merge branch 'main' into dev Karim shoair 2026-03-26 17:54:49 +02:00
• f36ddb4b16 docs: update a sponsor url Karim shoair 2026-03-26 00:04:47 +02:00
• 8e19f825a4 docs(skill): adjustment Karim shoair 2026-03-25 01:47:52 +02:00
• c2c02dc78e docs: updating the agent skill for Clawhub validation Karim shoair 2026-03-25 01:38:11 +02:00
• 422b4713ec build: pump up version Karim shoair 2026-03-25 00:19:58 +02:00
• 9fee49c928 test: fixes to storage tests Karim shoair 2026-03-25 00:13:42 +02:00
• 3757cf6d77 test: add save/retrieve round-trip and core storage coverage (#193) Karim shoair 2026-03-25 00:11:42 +02:00
• 30ffe76cfa Merge branch 'dev' into test/storage-core-coverage Karim shoair 2026-03-24 22:42:58 +02:00
• 3b4cae6889 Merge branch 'main' into dev Karim shoair 2026-03-24 22:21:07 +02:00
• 6635a4ad72 docs: adding a new sponsor Karim shoair 2026-03-24 17:13:24 +02:00
• 718db42ff0 Merge branch 'main' into dev Karim shoair 2026-03-23 16:40:12 +02:00