Commit Graph

815 Commits

Author SHA1 Message Date
Karim shoair e53ce3f749 refactor: Making the requests logic better and cleaner
Also, solve some bugs along the way and a cleaner fix for #97
2025-10-06 05:00:41 +03:00
Karim shoair cc45ded0cf ops: update pre-commit hooks 2025-10-05 04:12:18 +03:00
Karim shoair c01fefadea ops: change docker workflow trigger 2025-10-05 04:11:14 +03:00
Karim shoair f4ce433ff3 build: pump up the version and deps 2025-10-05 04:08:19 +03:00
Karim shoair b80f866434 docs: update an outdated part 2025-10-05 04:04:09 +03:00
Karim shoair debe03256b refactor: Making all the codebase acceptable by PyRight
Also fixes #97
2025-10-05 04:03:39 +03:00
Karim shoair e149c715dd feat(CF solver): better implementation to help with all custom implementations of turnstile 2025-10-02 20:05:39 +03:00
Karim shoair db1179790e docs: correcting docker installation instruction 2025-10-01 07:30:49 +03:00
Karim shoair 653fbb0594 ops: fix docker image name 2025-10-01 07:19:48 +03:00
Karim shoair e8b0e72512 v0.3.6 (#95) 2025-10-01 06:40:04 +03:00
Karim shoair a7e29a1662 docs: Update introduction 2025-10-01 06:26:19 +03:00
Karim shoair 5127d386c9 style(Fetcher): correcting type hints and annotation 2025-10-01 06:18:23 +03:00
Karim shoair 849913ad77 style: Correcting return type annotation for Fetcher/AsyncFetcher (#93) 2025-10-01 04:17:59 +03:00
Karim shoair 7aa083053b test: change tests accordingly 2025-10-01 03:50:57 +03:00
Karim shoair eedfa855ab fix: Fixes for the type checking in the main init file
and a bit of cleaning
2025-10-01 03:50:39 +03:00
Karim shoair 4135dd86b8 refactor: Restructure the fetchers code to not use more memory than needed
Also fixes: #92
2025-10-01 03:48:43 +03:00
Karim shoair ec3809ce40 docs: fix installation section on the website 2025-09-29 17:50:45 +03:00
Karim shoair f6c122b87f style: Removing dead code/docstrings 2025-09-29 05:09:23 +03:00
Karim shoair 8ad7cd6343 docs: Update all pages/docstrings to reflect recent changes 2025-09-29 03:57:40 +03:00
Karim shoair 0cf3bcf3aa ops: improve the layering of the docker image 2025-09-29 02:53:06 +03:00
Karim shoair 840aef6884 build: Pump up version and deps 2025-09-28 22:04:09 +03:00
Karim shoair 2bad72b77a fix: correct http option type in the mcp server 2025-09-28 21:19:51 +03:00
Karim shoair 6f0ce428aa tests: update tests for mcp 2025-09-28 20:14:17 +03:00
Karim shoair 74f20d2a0e refactor: better implementation for the mcp mode 2025-09-28 20:14:04 +03:00
Karim shoair 0b729176bc ops: add workflow to build and push docker images 2025-09-28 04:56:01 +03:00
Karim shoair 8a867fc68e feat: Add docker support 2025-09-28 04:55:00 +03:00
Karim shoair 4a661b4875 feat: Make mcp able to use http transport 2025-09-28 04:54:35 +03:00
Karim shoair 292208e22d build: update bandit rules 2025-09-28 04:54:27 +03:00
Karim shoair 716a5c3572 feat(cf solver): Make solver able to handle Turnstile and interstitial 2025-09-28 02:53:51 +03:00
Karim shoair 3da806210b perf: General code restructure to not use more than needed memory 2025-09-23 18:34:54 +03:00
Karim shoair 63a46a8e0b fix(parser): An encoding issue with converting bytes to string on some encoding types
Removing that `invalid start byte` annoying bug
2025-09-23 18:32:56 +03:00
Karim shoair 38e7941b71 docs: add a new sponsor 2025-09-22 16:03:13 +03:00
Karim shoair 61078ca1d2 v0.3.5 (#89) 2025-09-20 15:57:08 +03:00
Karim shoair 82b09620b2 perf: Improving all browser-based fetches by ~15% 2025-09-20 06:20:23 +03:00
Karim shoair 970ad40404 perf: Speed up sync fetches by ignoring number of pages checking 2025-09-20 04:31:57 +03:00
Karim shoair 5164b801ec build: pump version up and update deps 2025-09-20 00:33:07 +03:00
Karim shoair 67aa1a2ae7 tests: Add a test for using stealth and real_chrome arguments together 2025-09-20 00:23:55 +03:00
Karim shoair 67db865aee feat(DynamicFetcher): Replace rebrowser with patchright 2025-09-20 00:23:29 +03:00
Karim shoair 386da62ec9 tests: fix CLI tests according to last changes 2025-09-19 23:17:54 +03:00
Karim shoair 0ee3f93227 Merge branch 'main' into dev 2025-09-19 07:01:53 +03:00
Karim shoair 165dc524f8 docs: add a new sponsor 2025-09-19 06:06:30 +03:00
Karim shoair 2d704b2a8b fix(shell): Fixing a bug with content converting 2025-09-19 04:50:15 +03:00
Karim shoair a9d05cc0ef style: Removing dead code/docstrings and correcting type hints 2025-09-19 04:49:30 +03:00
Karim shoair bf5fe6d451 fix(shell): Fix view command edge case 2025-09-19 04:21:15 +03:00
Karim shoair 504ecdf7dc fix(shell): Fix parsing curl --data-raw 2025-09-19 04:20:16 +03:00
Karim shoair b197f8a5f9 fix(parser): Improve selectors re function 2025-09-18 13:56:37 +03:00
Karim shoair 41c8a2dcca Merge branch 'main' into dev 2025-09-18 13:55:48 +03:00
Karim shoair 189f323904 misc: update sponsor poster 2025-09-18 13:31:17 +03:00
Karim shoair ddf5b52e3b Improve page management and speed up execution (#87) 2025-09-18 03:34:40 +03:00
Abdullah 7ba333c3c9 perf(session): improve page management and speed up execution
Close pages immediately after tasks finish to reduce resource usage and
improve overall performance. Update corresponding test files to reflect
the new page lifecycle management.
2025-09-17 18:49:45 +03:00