Karim shoair
264ae02aa7
refactor: huge change, many features/class got a better naming
...
- `Adaptor` became `Selector`
- `Adaptors` became `Selectors`
- `auto_match` argument/feature became `adaptive`
- `adaptor_arguments` argument became `selector_config`
- `automatch_domain` argument became `adaptive_domain`
- `additional_arguments` argument became `additional_args`
- `storage_adaptors` file became just `storage`
2025-07-29 04:20:23 +03:00
Karim shoair
d1aa0be6e4
refactor(StealthyFetcher): Remove virtual mode and use persistent context
...
Solves #64 completely too
2025-07-27 03:41:28 +03:00
Karim shoair
ecef751468
fix: small fix for fetcher
2025-07-14 02:14:54 +03:00
Karim shoair
63a9db21a1
refactor(DynamicSession): Optimization + Removing max_pages from sync version
2025-07-06 04:59:22 +03:00
Karim shoair
6d79927233
refactor(Fetcher): Fix the issue of caching impersonation state + Less code duplication
...
It now creates a session with each request, but at the same time, it's still faster than the fetcher in v0.2.99 by 20% with more features enabled.
2025-07-06 02:21:15 +03:00
Karim shoair
dbf7aa7761
feat(DynamicFetcher): Use persistent context by default for better stealth
...
And might solve the sandbox issue with GitHub
2025-06-27 03:02:46 +03:00
Karim shoair
8395db9121
fix(controllers): Fix issue with async adding stealth scripts
2025-06-27 01:39:32 +03:00
Karim shoair
37e842b796
fix(controllers): Fix issue with adding stealth scripts
2025-06-27 01:04:58 +03:00
Karim shoair
53318f3a2a
fix(StealthyFetcher): Fix passed proxy type
2025-06-26 16:36:30 +03:00
Karim shoair
8d44e9c51c
fix(proxy): fix proxy unpacking
2025-06-26 15:49:53 +03:00
Karim shoair
38851698ad
refactor: optimize imports and docstrings correction
2025-06-25 23:15:32 +03:00
Karim shoair
724e3a648e
fix(FetcherSession): Use Sentinel pattern to solve arguments precedence issue
2025-06-25 03:53:54 +03:00
Karim shoair
63ff12bcd6
docs: correcting a small mistake
2025-06-23 03:38:34 +03:00
Karim shoair
78b81c537f
fix(fetchers): Fix the bug of referer and google_search argument conflict
2025-06-23 03:36:11 +03:00
Karim shoair
69b983b42f
feat(fetchers): Improve StealthyFetcher + Adding StealthySession/AsyncStealthySession classes
2025-06-23 03:23:28 +03:00
Karim shoair
3754547e58
refactor: removing unused code
2025-06-23 03:20:49 +03:00
Karim shoair
460b4443c2
refactor(controllers): Improve type validation
2025-06-22 19:59:40 +03:00
Karim shoair
0fe04e499f
refactor(validators): Optimize imports
2025-06-22 18:55:13 +03:00
Karim shoair
fc42487a5f
refactor(controllers): Optimize imports
2025-06-22 18:53:44 +03:00
Karim shoair
9c44ad1930
fix(AsyncFetcher): Fix stealthy_headers issue
2025-06-22 03:54:36 +03:00
Karim shoair
8a272cf19b
feat/refactor(fetchers): Replacing PlayWrightFetcher with DynamicFetcher and adding session classes
2025-06-22 02:10:45 +03:00
Karim shoair
0a570a7ca7
docs: Updating doc strings
2025-06-22 01:59:38 +03:00
Karim shoair
d049f63404
fix(fetcher): Fix impersonate and headers generation conflict
2025-06-20 03:29:05 +03:00
Karim shoair
9bfc900140
feat(navigation tools): Improvements
2025-06-19 04:07:45 +03:00
Karim shoair
145b710960
feat(fetchers): Adding the foundation of the new browser-based fetchers logic
2025-06-19 04:06:52 +03:00
Karim shoair
2bdee60004
fix(fingerprints): Fixing headers generation for requests
2025-06-15 03:37:22 +03:00
Karim shoair
1f34ac22f6
style(fetcher): Move the default UA line
2025-06-15 03:21:21 +03:00
Karim shoair
7efbcd33c3
refactor(fingerprints): Remove unused function and improve another
2025-06-15 03:16:27 +03:00
Karim shoair
6e837f6a12
refactor(StealthyFetcher): Improve OS name extraction
2025-06-14 18:57:31 +03:00
Karim shoair
178eed7533
feat/fix(Fetcher): Adding http3 support + Fix stealthy_headers
...
And some fixes here and there to the docs
2025-05-31 03:35:46 +03:00
Karim shoair
c46ca8873f
refactor(fetchers): Optimizing fetchers + making PlayWrightFetcher 10% faster
...
Check out the Discord server for full details
2025-05-25 21:14:24 +03:00
Karim shoair
9e68e60161
feat(Fetcher): Replacing httpx + Adding FetcherSession
...
Check out the discord server for details
2025-05-25 21:10:20 +03:00
Karim shoair
bf72678480
feat(cookies): The ability to pass cookies to browser fetchers
2025-05-10 19:36:53 +03:00
Karim shoair
c84143129e
fix(fetchers): Adjusting all cookies returned from each fetcher
...
The cookies returned now can be passed again to each fetcher's engine without further validation by us.
2025-05-10 19:16:34 +03:00
Karim shoair
bd47c070aa
fix(StealthyFetcher): Adjustments
2025-05-10 17:49:03 +03:00
Karim shoair
fd33e35ff8
feat(StealthyFetcher): adding the option to solve Cloudflare Turnstile
2025-05-08 01:08:04 +03:00
Karim shoair
6c0b786dea
docs(playwrightfetcher): improving docstring
2025-05-08 01:04:08 +03:00
Karim shoair
1240ee3eb0
fix(Fetcher): Fix the issue of passing cookies
2025-04-29 03:01:19 +03:00
Karim shoair
0c8dd63f87
chore: migrating to ruff and updating pre-commit hooks
2025-04-13 17:32:00 +02:00
Karim shoair
a79bf3cc9d
feat(StealthyFetcher): adding the wait option
...
This will make fetcher sleep after fetch before closing the page
2025-04-08 03:08:48 +02:00
Karim shoair
8f5d66f678
fix(StealthyFetcher): fix redirection issue with async_fetch
2025-04-08 02:58:10 +02:00
Karim shoair
d6a3434402
fix(PlayWrightFetcher): fix redirection issue with async_fetch
2025-04-08 02:57:01 +02:00
Karim shoair
128f7b9d6f
feat(PlayWrightFetcher): adding the option to sleep after fetch before closing the page
2025-04-08 02:54:46 +02:00
Karim shoair
eb4ca2c6a4
fix(StealthyFetcher): change additional_arguments to a dictionary argument
2025-04-08 02:24:43 +02:00
Karim shoair
811cd2d9b0
refactor: make auto_match disabled by default
2025-03-26 19:25:19 +02:00
Karim shoair
fec8215631
docs: Clearer docs for recent changes
2025-03-26 05:56:49 +02:00
Karim shoair
d33e738c53
feat(StealthyFetcher): The ability to pass additional arguments to Camoufox
2025-03-26 05:36:05 +02:00
Karim shoair
7c0c23fd33
feat(unified import): Make one import for all fetchers
...
Why I didn't think of that from the start? IDK
2025-03-26 02:48:34 +02:00
Karim shoair
ff3962b1ad
fix: Adjusting cache size in all the library
2025-03-17 06:46:41 +02:00
Karim shoair
7bef44ea4c
fix: Limit caching in all the library
...
To lower memory usage with high numbers of requests. Possibly improve case #48
2025-03-15 02:01:16 +02:00