330d03559c
style: applying the new ruff rules to all files
2025-09-13 03:22:53 +03:00
05a714980d
docs: Update all docstring according to the new changes
2025-09-11 04:13:36 +03:00
ecaec65049
refactor/fix(browser fetchers): Solving a logic bug in page rotation
...
- Pages that get reused in rotation are possibly contaminated from previous settings used on them, and some are stubborn to remove, so the new approach replaces finished pages with new ones.
- Removed the `max_pages` from sync `StealthySession` to match `DynamicSession` (Doesn't mean anything in sync code)
2025-09-08 16:08:57 +03:00
6ad1bab2e4
feat(DynamicFetcher): add the ability to add init_script to context ( #56 )
2025-09-02 16:25:13 +03:00
9543f171aa
feat(StealthyFetcher): add the ability to add init_script to context
2025-09-02 16:19:22 +03:00
ae9ccaec79
style: A lot of type hints correction
...
Since we are using Py3.10 as minimum version now, we remove Union when possible
2025-07-30 02:46:57 +03:00
ba585c0adc
perf: imports optimizing
2025-07-30 00:22:06 +03:00
264ae02aa7
refactor: huge change, many features/class got a better naming
...
- `Adaptor` became `Selector`
- `Adaptors` became `Selectors`
- `auto_match` argument/feature became `adaptive`
- `adaptor_arguments` argument became `selector_config`
- `automatch_domain` argument became `adaptive_domain`
- `additional_arguments` argument became `additional_args`
- `storage_adaptors` file became just `storage`
2025-07-29 04:20:23 +03:00
d1aa0be6e4
refactor(StealthyFetcher): Remove virtual mode and use persistent context
...
Solves #64 completely too
2025-07-27 03:41:28 +03:00
2b73fdbfd7
fix(DynamicFetcher): Remove old argument
2025-07-06 05:02:16 +03:00
6d79927233
refactor(Fetcher): Fix the issue of caching impersonation state + Less code duplication
...
It now creates a session with each request, but at the same time, it's still faster than the fetcher in v0.2.99 by 20% with more features enabled.
2025-07-06 02:21:15 +03:00
63ff12bcd6
docs: correcting a small mistake
2025-06-23 03:38:34 +03:00
69b983b42f
feat(fetchers): Improve StealthyFetcher + Adding StealthySession/AsyncStealthySession classes
2025-06-23 03:23:28 +03:00
fc530677de
refactor(DynamicFetcher): Cleaner exit for fetch
2025-06-23 02:58:01 +03:00
22490db85f
fix(DynamicFetcher): Set number of tabs to 1
...
There is no logical use for it here; seek the session classes to use it.
2025-06-23 02:42:43 +03:00
8a272cf19b
feat/refactor(fetchers): Replacing PlayWrightFetcher with DynamicFetcher and adding session classes
2025-06-22 02:10:45 +03:00
c46ca8873f
refactor(fetchers): Optimizing fetchers + making PlayWrightFetcher 10% faster
...
Check out the Discord server for full details
2025-05-25 21:14:24 +03:00
9e68e60161
feat(Fetcher): Replacing httpx + Adding FetcherSession
...
Check out the discord server for details
2025-05-25 21:10:20 +03:00
bf72678480
feat(cookies): The ability to pass cookies to browser fetchers
2025-05-10 19:36:53 +03:00
fd33e35ff8
feat(StealthyFetcher): adding the option to solve Cloudflare Turnstile
2025-05-08 01:08:04 +03:00
6c0b786dea
docs(playwrightfetcher): improving docstring
2025-05-08 01:04:08 +03:00
1240ee3eb0
fix(Fetcher): Fix the issue of passing cookies
2025-04-29 03:01:19 +03:00
0c8dd63f87
chore: migrating to ruff and updating pre-commit hooks
2025-04-13 17:32:00 +02:00
a79bf3cc9d
feat(StealthyFetcher): adding the wait option
...
This will make fetcher sleep after fetch before closing the page
2025-04-08 03:08:48 +02:00
128f7b9d6f
feat(PlayWrightFetcher): adding the option to sleep after fetch before closing the page
2025-04-08 02:54:46 +02:00
eb4ca2c6a4
fix(StealthyFetcher): change additional_arguments to a dictionary argument
2025-04-08 02:24:43 +02:00
d33e738c53
feat(StealthyFetcher): The ability to pass additional arguments to Camoufox
2025-03-26 05:36:05 +02:00
7ca8aaf2df
feat(custom_config): The ability to pass custom parser config to requests
2025-03-26 03:56:56 +02:00
7c0c23fd33
feat(unified import): Make one import for all fetchers
...
Why I didn't think of that from the start? IDK
2025-03-26 02:48:34 +02:00
4f75827641
refactor(fetchers): Clearer more accurate type hints
2025-03-15 01:47:41 +02:00
c0d912d16a
fix(asyncFetcher): A typo made async version of put do post request instead
...
Awkward moment
2025-01-30 19:53:13 +02:00
675c0110e6
feat(StealthyFetcher): Make ads enabled by default for performance boost
2025-01-28 23:51:31 +02:00
5be8c2a95e
style(Fetchers): Setting correct type hint for wait_selector_state argument
2024-12-19 13:22:12 +02:00
79a911e24e
feat(StealthyFetcher): Add async fetch support
2024-12-16 00:59:19 +02:00
af4f2c0f74
feat(PlaywrightFetcher): Add async support for PlaywrightFetcher
2024-12-16 00:15:47 +02:00
b10cfd3643
feat: Adding AsyncFetcher class version of Fetcher
...
The first step in fully supporting async
2024-12-15 16:51:58 +02:00
faf728a794
style: moving repeated arguments from inside the functions to __init__
...
Might give a slight performance increase too
2024-12-15 16:49:48 +02:00
445af3c702
perf: Give repeated usage of Fetcher a slight performance increase
...
By caching the `StaticEngine` class instance
2024-12-15 16:13:08 +02:00
299793af3f
feat: adding the retries argument for all methods of Fetcher class
2024-12-15 15:59:15 +02:00
bfe906315e
feat: adding geoip parameter to the StealthyFetcher
2024-12-12 12:43:49 +02:00
d0f18951ac
fix: Enable WebGL by default
2024-12-04 23:38:30 +02:00
1a17b2ce46
Sorting all library imports with isort
2024-11-30 14:02:06 +02:00
dbd674aa7c
Adding proxy support for basic requests
2024-11-26 21:24:41 +02:00
d6a59774ea
StealthyFetcher - The option to disable ads with ublock origin addon
2024-11-26 20:23:02 +02:00
60d551d839
PlaywrightFetcher - Add the option to set locale of the browser
2024-11-26 17:39:03 +02:00
12d638ac2e
Updating the doc to reflect new changes
2024-11-24 15:20:18 +02:00
a8c576ad28
Adding the real_chrome option to the fetcher
2024-11-24 15:15:08 +02:00
7f330efc52
Turn-off the hide_canvas option by default
2024-11-24 13:44:16 +02:00
f443d774c1
Fixing the doc-string to match Sphinx
2024-11-19 14:33:54 +02:00
90e38af552
Correcting the return string for the Response object in all functions/methods
2024-11-15 16:44:47 +02:00
Karim shoair