Commit Graph

526 Commits

Author SHA1 Message Date
Karim shoair 51b5c4dff8 Merge branch 'main' into dev 2025-07-10 21:17:39 +03:00
Karim shoair 377ad92485 docs: update PetroSky promo 2025-07-10 21:14:34 +03:00
Karim shoair 6eb9626865 docs: add PetroSky as sponsor 2025-07-10 21:12:54 +03:00
Karim shoair 8af4833c64 chore: add new sponsor poster 2025-07-10 21:00:06 +03:00
Karim shoair 96be8af1b3 chore: add new sponsor poster 2025-07-10 20:56:20 +03:00
Karim shoair 1c6a960f17 Merge branch 'main' into dev 2025-07-09 19:39:08 +03:00
Karim shoair 119e00e16d chore: Delete the "others" issue template 2025-07-09 19:30:06 +03:00
Karim shoair fe8b11155e test: remove tests for Python 3.9 2025-07-09 16:31:05 +03:00
Karim shoair 4bba8598c2 build: update deps 2025-07-09 16:20:21 +03:00
Karim shoair 403f7bfe72 build: Updating PyPI classifiers 2025-07-07 00:10:20 +03:00
Karim shoair 939b78f3cf build: adding mcp as dependency 2025-07-07 00:09:54 +03:00
Karim shoair 3184dd8581 build: set minimum version to Python 3.10 2025-07-07 00:09:02 +03:00
Karim shoair 2b73fdbfd7 fix(DynamicFetcher): Remove old argument 2025-07-06 05:02:16 +03:00
Karim shoair 2ecf9b0c20 build: Improve description 2025-07-06 05:01:19 +03:00
Karim shoair 63a9db21a1 refactor(DynamicSession): Optimization + Removing max_pages from sync version 2025-07-06 04:59:22 +03:00
Karim shoair 6d79927233 refactor(Fetcher): Fix the issue of caching impersonation state + Less code duplication
It now creates a session with each request, but at the same time, it's still faster than the fetcher in v0.2.99 by 20% with more features enabled.
2025-07-06 02:21:15 +03:00
Karim shoair 18e56a8c50 refactor: Optimizing extract command and cleaning code 2025-06-29 19:40:03 +03:00
Karim shoair 29e485bdf2 refactor: Optimizations to CLI 2025-06-29 19:10:52 +03:00
Karim shoair b28f90e854 build: Update deps 2025-06-29 18:58:36 +03:00
Karim shoair 1c9e48b1c6 feat(extract): Adding new command to CLI options + Optimizations
Users can now fetch websites directly without code and extract full/selected HTML content as HTML, Markdown, or extract text content.
2025-06-29 18:56:09 +03:00
Karim shoair ce034f9f79 test: remove problematic test 2025-06-28 18:24:08 +03:00
Karim shoair b02f0bd236 ops: Adjust tox file to avoid CI issues 2025-06-28 18:12:38 +03:00
Karim shoair ac3db69c47 ops: new approach to CI tests workflow 2025-06-28 17:40:19 +03:00
Karim shoair ee1a0828a2 ops: Correcting cache paths 2025-06-27 17:16:35 +03:00
Karim shoair d603c15212 ops: rewrite tests logic to cache downloaded browsers before testing 2025-06-27 16:02:16 +03:00
Karim shoair 4ee32af67b ops: fix for GitHub's CI 2025-06-27 14:50:06 +03:00
Karim shoair 3578a07c0a ops: fix for test deps 2025-06-27 14:35:12 +03:00
Karim shoair 94edb92bc3 ops: update hashing for the cache 2025-06-27 14:19:07 +03:00
Karim shoair 941ed20a15 ops: switch tests to use MacOS 2025-06-27 03:19:58 +03:00
Karim shoair d6f8926d7a ops: switch tests to Windows system instead of Linux 2025-06-27 03:08:42 +03:00
Karim shoair dbf7aa7761 feat(DynamicFetcher): Use persistent context by default for better stealth
And might solve the sandbox issue with GitHub
2025-06-27 03:02:46 +03:00
Karim shoair 76248eabf6 ops: possible fix for sandbox issue with GitHub's CI 2025-06-27 03:01:27 +03:00
Karim shoair 9b62b59490 ops: possible fix for sandbox issue with GitHub's CI 2025-06-27 02:26:35 +03:00
Karim shoair e535a3fa16 ops: fix sandbox issue with GitHub's CI 2025-06-27 02:14:53 +03:00
Karim shoair 5895edef57 ops: fix test workflow for GitHub 2025-06-27 01:42:22 +03:00
Karim shoair 8395db9121 fix(controllers): Fix issue with async adding stealth scripts 2025-06-27 01:39:32 +03:00
Karim shoair 228d294afc test: Enable Dynamic stealth tests again
It's problematic with GitHub but letsgo
2025-06-27 01:15:06 +03:00
Karim shoair 37e842b796 fix(controllers): Fix issue with adding stealth scripts 2025-06-27 01:04:58 +03:00
Karim shoair 53318f3a2a fix(StealthyFetcher): Fix passed proxy type 2025-06-26 16:36:30 +03:00
Karim shoair 8d44e9c51c fix(proxy): fix proxy unpacking 2025-06-26 15:49:53 +03:00
Karim shoair 38851698ad refactor: optimize imports and docstrings correction 2025-06-25 23:15:32 +03:00
Karim shoair a41be48047 refactor: optimize imports and docstrings correction 2025-06-25 21:36:53 +03:00
Karim shoair a3a5e34408 refactor: optimize imports and docstrings correction 2025-06-25 21:36:43 +03:00
Karim shoair 724e3a648e fix(FetcherSession): Use Sentinel pattern to solve arguments precedence issue 2025-06-25 03:53:54 +03:00
Karim shoair 63ff12bcd6 docs: correcting a small mistake 2025-06-23 03:38:34 +03:00
Karim shoair 78b81c537f fix(fetchers): Fix the bug of referer and google_search argument conflict 2025-06-23 03:36:11 +03:00
Karim shoair 560ae95281 test: Adjusting tests with the correct timeout 2025-06-23 03:24:13 +03:00
Karim shoair 69b983b42f feat(fetchers): Improve StealthyFetcher + Adding StealthySession/AsyncStealthySession classes 2025-06-23 03:23:28 +03:00
Karim shoair 3754547e58 refactor: removing unused code 2025-06-23 03:20:49 +03:00
Karim shoair fc530677de refactor(DynamicFetcher): Cleaner exit for fetch 2025-06-23 02:58:01 +03:00