Commit Graph

1011 Commits

Author SHA1 Message Date
Karim shoair b7327466cf build: pump version up 2025-09-15 23:35:08 +03:00
Karim shoair 05c2d9aa00 feat(CLI): Make the session classes available in the shell 2025-09-15 23:34:36 +03:00
Karim shoair 5bcd4c2927 fix: A workaround for Playwright issue with page content retrieving on windows 2025-09-15 21:34:20 +03:00
Karim shoair bdcf96fa9e Merge branch 'main' into dev 2025-09-15 21:33:49 +03:00
Karim shoair 1547366c85 fix: fixing body issue with cli view command 2025-09-15 21:32:57 +03:00
Karim shoair 8a54745e47 v0.3.3 (#84) 2025-09-15 14:06:24 +03:00
Karim shoair f3a1f1ecb4 Merge branch 'main' into dev 2025-09-15 13:52:40 +03:00
Karim shoair a6aabda67c build: Pump version up 2025-09-15 13:52:09 +03:00
Karim shoair 7a7097b775 fix: Stop removing browser default page
Looks like it's problematic with some systems so it doesn't worth the trouble
2025-09-15 13:43:47 +03:00
Karim shoair fac92ef260 v0.3.2 (#83) 2025-09-15 04:28:55 +03:00
Karim shoair 3bf06a8521 docs: clarifying updates 2025-09-15 01:39:19 +03:00
Karim shoair f848e6b7f2 fix: Fixes to handle the new extra deps group 2025-09-15 00:19:19 +03:00
Karim shoair c7b9d45232 ops: Make tests workflow doesn't run when the changes isn't code related 2025-09-14 21:35:58 +03:00
Karim shoair d259b85c5b docs: Updating benchmarks with the latest version of all libraries 2025-09-14 21:26:28 +03:00
Karim shoair fdac239fcc build: Move click library to be part of the fetchers extra 2025-09-14 20:32:46 +03:00
Karim shoair eae088a07b tests: Multiple changes to tests
- Remove all tests for the old encoding logic
- Stop using the `nopecha` test page to test Cloudflare solver
- Remove useless tests like testing for infinite timeout
- Fixes to make the code compatible with new changes
2025-09-14 20:24:46 +03:00
Karim shoair ce4fc31f2c feat: Make .body return the passed content as it is without any processing
This makes it possible to download files and deal with non-HTML requests (ex: #81 )
2025-09-14 20:21:45 +03:00
Karim shoair 67ca139ff9 fix: Fixes for multiple encoding issues (#80 & #81 ) 2025-09-14 20:20:29 +03:00
Karim shoair 68615b2347 tests: remove the cloudflare test from the sync version
To not put pressure on the website
2025-09-14 16:31:38 +03:00
Karim shoair 1024ba6916 tests: Update test to be up-to-date with current version of the code 2025-09-14 16:30:59 +03:00
Karim shoair 0b3509a295 fix(shell): Fix a small typo 2025-09-14 05:05:55 +03:00
Karim shoair f604485a09 docs: Update all pages related to last changes 2025-09-14 04:45:56 +03:00
Karim shoair d6844232eb tests: Update all tests according to new update 2025-09-13 16:07:54 +03:00
Karim shoair 13d7e70cb7 refactor: Make all fetchers as an optional dependency group
+ Removing some dead code
2025-09-13 16:07:48 +03:00
Karim shoair d7e3deae2a fix: fix invalid dep version 2025-09-13 05:10:56 +03:00
Karim shoair 521366e77e build: bump up deps 2025-09-13 04:29:09 +03:00
Karim shoair 80077953f6 docs: update all pages related to last changes 2025-09-13 04:19:16 +03:00
Karim shoair 8c4d6158d6 feat(browser fetchers): A new option to control page JS 2025-09-13 03:59:12 +03:00
Karim shoair aaec00563c ops: update pre-commit hooks 2025-09-13 03:34:28 +03:00
Karim shoair 330d03559c style: applying the new ruff rules to all files 2025-09-13 03:22:53 +03:00
Karim shoair 60be9dc816 feat: Validate all fetch-level parameters
So it's validated like the session-level ones. Needs improvement, but that's for later
2025-09-13 03:22:08 +03:00
Karim shoair 831eafca34 ops: Update ruff pre-commit rules 2025-09-13 03:07:15 +03:00
Karim shoair 0c7db3c9d9 fix: validation keywords 2025-09-13 02:07:04 +03:00
Karim shoair adb82008e5 style: Using keywords for validation
Less lines of code and more stylish
2025-09-12 04:33:00 +03:00
Karim shoair e4b1e00e63 build: Pump up the version 2025-09-11 04:14:32 +03:00
Karim shoair 05a714980d docs: Update all docstring according to the new changes 2025-09-11 04:13:36 +03:00
Karim shoair 9838d741d0 refactor/feat(browser fetchers): make it possible to have a configuration per page in sessions
- Also, no need for the `page_action` argument function to return the page again
2025-09-11 03:48:55 +03:00
Karim shoair 931993f901 tests: changing tests accordingly 2025-09-08 16:09:24 +03:00
Karim shoair ecaec65049 refactor/fix(browser fetchers): Solving a logic bug in page rotation
- Pages that get reused in rotation are possibly contaminated from previous settings used on them, and some are stubborn to remove, so the new approach replaces finished pages with new ones.
- Removed the `max_pages` from sync `StealthySession` to match `DynamicSession` (Doesn't mean anything in sync code)
2025-09-08 16:08:57 +03:00
Karim shoair f298b76b8e perf(StealthySession): Close persistent context default page 2025-09-07 18:48:51 +03:00
Karim shoair 710f994339 perf(DynamicSession): Close persistent context default page 2025-09-07 18:48:40 +03:00
Karim shoair 05761d4070 docs: Add YT video to the mcp page 2025-09-07 05:06:35 +03:00
Karim shoair 4341477a66 perf(StealthyFetcher): Slight optimization 2025-09-07 04:58:55 +03:00
Karim shoair 9e5ff5bb1b chore: Add issue template for other issues 2025-09-07 04:36:00 +03:00
Karim shoair 72e26c23e8 fix(DynamicFetcher): Improve stealth mode 2025-09-07 03:13:51 +03:00
Karim shoair 31c14b3997 [ImgBot] Optimize images (#79) 2025-09-05 13:51:45 +03:00
Karim shoair fa76d64d61 docs: add new sponsor to the README 2025-09-05 13:46:17 +03:00
ImgBotApp d46d0fdf39 [ImgBot] Optimize images
*Total -- 555.83kb -> 366.23kb (34.11%)

/docs/assets/scrapling_shell_curl.png -- 527.22kb -> 342.98kb (34.95%)
/images/NSTproxy.png -- 28.61kb -> 23.25kb (18.74%)

Signed-off-by: ImgBotApp <ImgBotHelp@gmail.com>
2025-09-05 10:45:19 +00:00
Karim shoair 6f232b3874 misc: add new sponsor logo 2025-09-05 13:44:37 +03:00
Karim shoair 23997f2755 v0.3.1 (#78) 2025-09-02 17:20:53 +03:00