Karim shoair
f848e6b7f2
fix: Fixes to handle the new extra deps group
2025-09-15 00:19:19 +03:00
Karim shoair
13d7e70cb7
refactor: Make all fetchers as an optional dependency group
...
+ Removing some dead code
2025-09-13 16:07:48 +03:00
Karim shoair
ae9ccaec79
style: A lot of type hints correction
...
Since we are using Py3.10 as minimum version now, we remove Union when possible
2025-07-30 02:46:57 +03:00
Karim shoair
3754547e58
refactor: removing unused code
2025-06-23 03:20:49 +03:00
Karim shoair
7efbcd33c3
refactor(fingerprints): Remove unused function and improve another
2025-06-15 03:16:27 +03:00
Karim shoair
c46ca8873f
refactor(fetchers): Optimizing fetchers + making PlayWrightFetcher 10% faster
...
Check out the Discord server for full details
2025-05-25 21:14:24 +03:00
Karim shoair
0c8dd63f87
chore: migrating to ruff and updating pre-commit hooks
2025-04-13 17:32:00 +02:00
Karim shoair
af4f2c0f74
feat(PlaywrightFetcher): Add async support for PlaywrightFetcher
2024-12-16 00:15:47 +02:00
Karim shoair
889c111855
refactor(Playwright Engine): Separate what we can for cleaner code and the async function later
...
The caching will give a slight performance increase with bulk requests
2024-12-15 23:25:02 +02:00
Karim shoair
1a17b2ce46
Sorting all library imports with isort
2024-11-30 14:02:06 +02:00
Karim shoair
19ad82caef
Calculate status text manually if it's not returned by PlayWright API
2024-11-20 13:27:18 +02:00
Karim shoair
2abb70218f
Adding the proxy support to browser-based Fetchers
2024-11-15 14:43:03 +02:00
Karim shoair
544d23b696
Toolbelt fingerprint functions - Doc strings and type annotations stuff
2024-11-03 23:31:09 +02:00
Karim shoair
2ff0fbb0e5
Engines utils - Navigation functions
...
- Adding doc strings and type annotations stuff.
- Making error messages more detailed.
- Renaming the `construct_websocket_url` function for more clarity.
2024-11-03 22:46:40 +02:00
Karim shoair
c8c494e73f
Adding a function to intercept and drop unwanted requests
2024-11-03 16:25:55 +02:00
Karim shoair
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00