Commit Graph

1253 Commits

Author SHA1 Message Date
Karim shoair 849913ad77 style: Correcting return type annotation for Fetcher/AsyncFetcher (#93) 2025-10-01 04:17:59 +03:00
Karim shoair 7aa083053b test: change tests accordingly 2025-10-01 03:50:57 +03:00
Karim shoair eedfa855ab fix: Fixes for the type checking in the main init file
and a bit of cleaning
2025-10-01 03:50:39 +03:00
Karim shoair 4135dd86b8 refactor: Restructure the fetchers code to not use more memory than needed
Also fixes: #92
2025-10-01 03:48:43 +03:00
Karim shoair ec3809ce40 docs: fix installation section on the website 2025-09-29 17:50:45 +03:00
Karim shoair f6c122b87f style: Removing dead code/docstrings 2025-09-29 05:09:23 +03:00
Karim shoair 8ad7cd6343 docs: Update all pages/docstrings to reflect recent changes 2025-09-29 03:57:40 +03:00
Karim shoair 0cf3bcf3aa ops: improve the layering of the docker image 2025-09-29 02:53:06 +03:00
Karim shoair 840aef6884 build: Pump up version and deps 2025-09-28 22:04:09 +03:00
Karim shoair 2bad72b77a fix: correct http option type in the mcp server 2025-09-28 21:19:51 +03:00
Karim shoair 6f0ce428aa tests: update tests for mcp 2025-09-28 20:14:17 +03:00
Karim shoair 74f20d2a0e refactor: better implementation for the mcp mode 2025-09-28 20:14:04 +03:00
Karim shoair 0b729176bc ops: add workflow to build and push docker images 2025-09-28 04:56:01 +03:00
Karim shoair 8a867fc68e feat: Add docker support 2025-09-28 04:55:00 +03:00
Karim shoair 4a661b4875 feat: Make mcp able to use http transport 2025-09-28 04:54:35 +03:00
Karim shoair 292208e22d build: update bandit rules 2025-09-28 04:54:27 +03:00
Karim shoair 716a5c3572 feat(cf solver): Make solver able to handle Turnstile and interstitial 2025-09-28 02:53:51 +03:00
Karim shoair 3da806210b perf: General code restructure to not use more than needed memory 2025-09-23 18:34:54 +03:00
Karim shoair 63a46a8e0b fix(parser): An encoding issue with converting bytes to string on some encoding types
Removing that `invalid start byte` annoying bug
2025-09-23 18:32:56 +03:00
Karim shoair 38e7941b71 docs: add a new sponsor 2025-09-22 16:03:13 +03:00
Karim shoair 61078ca1d2 v0.3.5 (#89) 2025-09-20 15:57:08 +03:00
Karim shoair 82b09620b2 perf: Improving all browser-based fetches by ~15% 2025-09-20 06:20:23 +03:00
Karim shoair 970ad40404 perf: Speed up sync fetches by ignoring number of pages checking 2025-09-20 04:31:57 +03:00
Karim shoair 5164b801ec build: pump version up and update deps 2025-09-20 00:33:07 +03:00
Karim shoair 67aa1a2ae7 tests: Add a test for using stealth and real_chrome arguments together 2025-09-20 00:23:55 +03:00
Karim shoair 67db865aee feat(DynamicFetcher): Replace rebrowser with patchright 2025-09-20 00:23:29 +03:00
Karim shoair 386da62ec9 tests: fix CLI tests according to last changes 2025-09-19 23:17:54 +03:00
Karim shoair 0ee3f93227 Merge branch 'main' into dev 2025-09-19 07:01:53 +03:00
Karim shoair 165dc524f8 docs: add a new sponsor 2025-09-19 06:06:30 +03:00
Karim shoair 2d704b2a8b fix(shell): Fixing a bug with content converting 2025-09-19 04:50:15 +03:00
Karim shoair a9d05cc0ef style: Removing dead code/docstrings and correcting type hints 2025-09-19 04:49:30 +03:00
Karim shoair bf5fe6d451 fix(shell): Fix view command edge case 2025-09-19 04:21:15 +03:00
Karim shoair 504ecdf7dc fix(shell): Fix parsing curl --data-raw 2025-09-19 04:20:16 +03:00
Karim shoair b197f8a5f9 fix(parser): Improve selectors re function 2025-09-18 13:56:37 +03:00
Karim shoair 41c8a2dcca Merge branch 'main' into dev 2025-09-18 13:55:48 +03:00
Karim shoair 189f323904 misc: update sponsor poster 2025-09-18 13:31:17 +03:00
Karim shoair ddf5b52e3b Improve page management and speed up execution (#87) 2025-09-18 03:34:40 +03:00
Abdullah 7ba333c3c9 perf(session): improve page management and speed up execution
Close pages immediately after tasks finish to reduce resource usage and
improve overall performance. Update corresponding test files to reflect
the new page lifecycle management.
2025-09-17 18:49:45 +03:00
Karim shoair 6b2675c7dd v0.3.4 (#86) 2025-09-16 15:50:22 +03:00
Karim shoair 1550ba64bb docs: Adding new sponsor 2025-09-16 15:35:22 +03:00
Karim shoair 570303f938 fix(parser): Make html_content and prettify return strings not bytes (depends on the encoding) 2025-09-16 01:58:51 +03:00
Karim shoair 5683965367 fix(sessions): Fixing a bug with max pages counter 2025-09-16 01:47:31 +03:00
Karim shoair b7327466cf build: pump version up 2025-09-15 23:35:08 +03:00
Karim shoair 05c2d9aa00 feat(CLI): Make the session classes available in the shell 2025-09-15 23:34:36 +03:00
Karim shoair 5bcd4c2927 fix: A workaround for Playwright issue with page content retrieving on windows 2025-09-15 21:34:20 +03:00
Karim shoair bdcf96fa9e Merge branch 'main' into dev 2025-09-15 21:33:49 +03:00
Karim shoair 1547366c85 fix: fixing body issue with cli view command 2025-09-15 21:32:57 +03:00
Karim shoair 8a54745e47 v0.3.3 (#84) 2025-09-15 14:06:24 +03:00
Karim shoair f3a1f1ecb4 Merge branch 'main' into dev 2025-09-15 13:52:40 +03:00
Karim shoair a6aabda67c build: Pump version up 2025-09-15 13:52:09 +03:00