ae9ccaec79
style: A lot of type hints correction
...
Since we are using Py3.10 as minimum version now, we remove Union when possible
2025-07-30 02:46:57 +03:00
ba585c0adc
perf: imports optimizing
2025-07-30 00:22:06 +03:00
264ae02aa7
refactor: huge change, many features/class got a better naming
...
- `Adaptor` became `Selector`
- `Adaptors` became `Selectors`
- `auto_match` argument/feature became `adaptive`
- `adaptor_arguments` argument became `selector_config`
- `automatch_domain` argument became `adaptive_domain`
- `additional_arguments` argument became `additional_args`
- `storage_adaptors` file became just `storage`
2025-07-29 04:20:23 +03:00
d1aa0be6e4
refactor(StealthyFetcher): Remove virtual mode and use persistent context
...
Solves #64 completely too
2025-07-27 03:41:28 +03:00
2b73fdbfd7
fix(DynamicFetcher): Remove old argument
2025-07-06 05:02:16 +03:00
6d79927233
refactor(Fetcher): Fix the issue of caching impersonation state + Less code duplication
...
It now creates a session with each request, but at the same time, it's still faster than the fetcher in v0.2.99 by 20% with more features enabled.
2025-07-06 02:21:15 +03:00
63ff12bcd6
docs: correcting a small mistake
2025-06-23 03:38:34 +03:00
69b983b42f
feat(fetchers): Improve StealthyFetcher + Adding StealthySession/AsyncStealthySession classes
2025-06-23 03:23:28 +03:00
fc530677de
refactor(DynamicFetcher): Cleaner exit for fetch
2025-06-23 02:58:01 +03:00
22490db85f
fix(DynamicFetcher): Set number of tabs to 1
...
There is no logical use for it here; seek the session classes to use it.
2025-06-23 02:42:43 +03:00
8a272cf19b
feat/refactor(fetchers): Replacing PlayWrightFetcher with DynamicFetcher and adding session classes
2025-06-22 02:10:45 +03:00
c46ca8873f
refactor(fetchers): Optimizing fetchers + making PlayWrightFetcher 10% faster
...
Check out the Discord server for full details
2025-05-25 21:14:24 +03:00
9e68e60161
feat(Fetcher): Replacing httpx + Adding FetcherSession
...
Check out the discord server for details
2025-05-25 21:10:20 +03:00
bf72678480
feat(cookies): The ability to pass cookies to browser fetchers
2025-05-10 19:36:53 +03:00
fd33e35ff8
feat(StealthyFetcher): adding the option to solve Cloudflare Turnstile
2025-05-08 01:08:04 +03:00
6c0b786dea
docs(playwrightfetcher): improving docstring
2025-05-08 01:04:08 +03:00
1240ee3eb0
fix(Fetcher): Fix the issue of passing cookies
2025-04-29 03:01:19 +03:00
0c8dd63f87
chore: migrating to ruff and updating pre-commit hooks
2025-04-13 17:32:00 +02:00
a79bf3cc9d
feat(StealthyFetcher): adding the wait option
...
This will make fetcher sleep after fetch before closing the page
2025-04-08 03:08:48 +02:00
128f7b9d6f
feat(PlayWrightFetcher): adding the option to sleep after fetch before closing the page
2025-04-08 02:54:46 +02:00
eb4ca2c6a4
fix(StealthyFetcher): change additional_arguments to a dictionary argument
2025-04-08 02:24:43 +02:00
d33e738c53
feat(StealthyFetcher): The ability to pass additional arguments to Camoufox
2025-03-26 05:36:05 +02:00
7ca8aaf2df
feat(custom_config): The ability to pass custom parser config to requests
2025-03-26 03:56:56 +02:00
7c0c23fd33
feat(unified import): Make one import for all fetchers
...
Why I didn't think of that from the start? IDK
2025-03-26 02:48:34 +02:00
4f75827641
refactor(fetchers): Clearer more accurate type hints
2025-03-15 01:47:41 +02:00
c0d912d16a
fix(asyncFetcher): A typo made async version of put do post request instead
...
Awkward moment
2025-01-30 19:53:13 +02:00
675c0110e6
feat(StealthyFetcher): Make ads enabled by default for performance boost
2025-01-28 23:51:31 +02:00
5be8c2a95e
style(Fetchers): Setting correct type hint for wait_selector_state argument
2024-12-19 13:22:12 +02:00
79a911e24e
feat(StealthyFetcher): Add async fetch support
2024-12-16 00:59:19 +02:00
af4f2c0f74
feat(PlaywrightFetcher): Add async support for PlaywrightFetcher
2024-12-16 00:15:47 +02:00
b10cfd3643
feat: Adding AsyncFetcher class version of Fetcher
...
The first step in fully supporting async
2024-12-15 16:51:58 +02:00
faf728a794
style: moving repeated arguments from inside the functions to __init__
...
Might give a slight performance increase too
2024-12-15 16:49:48 +02:00
445af3c702
perf: Give repeated usage of Fetcher a slight performance increase
...
By caching the `StaticEngine` class instance
2024-12-15 16:13:08 +02:00
299793af3f
feat: adding the retries argument for all methods of Fetcher class
2024-12-15 15:59:15 +02:00
bfe906315e
feat: adding geoip parameter to the StealthyFetcher
2024-12-12 12:43:49 +02:00
d0f18951ac
fix: Enable WebGL by default
2024-12-04 23:38:30 +02:00
1a17b2ce46
Sorting all library imports with isort
2024-11-30 14:02:06 +02:00
dbd674aa7c
Adding proxy support for basic requests
2024-11-26 21:24:41 +02:00
d6a59774ea
StealthyFetcher - The option to disable ads with ublock origin addon
2024-11-26 20:23:02 +02:00
60d551d839
PlaywrightFetcher - Add the option to set locale of the browser
2024-11-26 17:39:03 +02:00
12d638ac2e
Updating the doc to reflect new changes
2024-11-24 15:20:18 +02:00
a8c576ad28
Adding the real_chrome option to the fetcher
2024-11-24 15:15:08 +02:00
7f330efc52
Turn-off the hide_canvas option by default
2024-11-24 13:44:16 +02:00
f443d774c1
Fixing the doc-string to match Sphinx
2024-11-19 14:33:54 +02:00
90e38af552
Correcting the return string for the Response object in all functions/methods
2024-11-15 16:44:47 +02:00
5e8275c3eb
Adding the option to randomize the OS fingerprints with the StealthyFetcher
2024-11-15 16:36:32 +02:00
2abb70218f
Adding the proxy support to browser-based Fetchers
2024-11-15 14:43:03 +02:00
bd38fdb347
Corrections and rephrasing
2024-11-11 16:40:46 +02:00
03091beb8b
Small clarification
2024-11-09 13:40:50 +02:00
fd7d787ab0
Add extra_headers argument to PW and isolate google referer feature from stealth mode as google_search
2024-11-09 00:54:11 +02:00
Karim shoair