Commit Graph

390 Commits

Author SHA1 Message Date
Karim shoair 544d23b696 Toolbelt fingerprint functions - Doc strings and type annotations stuff 2024-11-03 23:31:09 +02:00
Karim shoair e270b00811 Toolbelt subpackage custom functions general adjustments 2024-11-03 23:17:20 +02:00
Karim shoair 2ff0fbb0e5 Engines utils - Navigation functions
- Adding doc strings and type annotations stuff.
- Making error messages more detailed.
- Renaming the `construct_websocket_url` function for more clarity.
2024-11-03 22:46:40 +02:00
Karim shoair b8afb390ae Renaming fetcher file to fetchers for clarity 2024-11-03 22:43:16 +02:00
Karim shoair 282b130864 Static Engine - Doc strings and type annotations stuff 2024-11-03 22:25:34 +02:00
Karim shoair 3af174526f PlayWright Engine - Doc strings and type annotations stuff 2024-11-03 22:24:44 +02:00
Karim shoair 54cacb8a4e Camoufox Engine - Doc strings and type annotations stuff 2024-11-03 22:20:29 +02:00
Karim shoair 61fd592a6a Adding documentation to PlaywrightFetcher class 2024-11-03 21:04:11 +02:00
Karim shoair c1575b8e2e Updating doc-strings for more clarity 2024-11-03 16:49:33 +02:00
Karim shoair 1d2c68125a Update fetcher.py 2024-11-03 16:40:42 +02:00
Karim shoair 3556d11fb2 StealthyFetcher - Add disable_resources option and its explanation 2024-11-03 16:33:08 +02:00
Karim shoair 711de81106 PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost 2024-11-03 16:27:55 +02:00
Karim shoair b32e1203f2 StealthyFetcher - The option to drop unnecessary resources requests for speed boost 2024-11-03 16:27:32 +02:00
Karim shoair c8c494e73f Adding a function to intercept and drop unwanted requests 2024-11-03 16:25:55 +02:00
Karim shoair e7e499d64b Add documentation for StealthyFetcher class + add webgl option 2024-11-03 14:45:20 +02:00
Karim shoair e7300ecba0 StealthFetcher - Add the option to allow webgl in the browser 2024-11-03 14:40:19 +02:00
Karim shoair 2528d4e023 Add documentation for the Fetcher class 2024-11-03 14:39:24 +02:00
Karim shoair be350f21dd Adding documentation to the base fetcher...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
Karim shoair eaae5908c9 Make auto_match enabled by default 2024-11-03 13:33:24 +02:00
Karim shoair 1ff1c93bcf Give response's body bytes priority over response's text 2024-11-03 13:04:02 +02:00
Karim shoair afe53332b8 Convert the request headers to dictionary to unify response object shape across engines 2024-11-03 13:01:48 +02:00
Karim shoair 942aa08c85 Handling JSON responses better 2024-11-03 13:00:23 +02:00
Karim shoair 145c03daff Big structure changes (check commit description)
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
Karim shoair 78c718c1d2 I don't know how that happened! 2024-11-02 21:17:56 +02:00
Karim shoair be2847ffb8 Bumping the library for version 0.2 for now and more adjustments 2024-10-31 02:14:41 +03:00
Karim shoair 3cb1696d6c Adding the main fetcher file to use for fetching pages 2024-10-31 02:13:35 +03:00
Karim shoair aadae4a25b Adding the JavaScript bypasses files for stealth mode 2024-10-31 02:12:37 +03:00
Karim shoair 8f8d08b568 Adding browsing engines 2024-10-31 02:11:33 +03:00
Karim shoair 6eeca3daa7 Going back to single utils file and using the new types file 2024-10-31 01:32:53 +03:00
Karim shoair 23c4181ff2 Using the new types file 2024-10-31 01:32:18 +03:00
Karim shoair 1ca2b6cfe4 Combing type definitions in one file 2024-10-31 01:31:10 +03:00
Karim shoair 327281c664 Making structure clearer to help with the next version 2024-10-26 21:32:57 +03:00
Karim shoair d546b3499b Handling an edge case and adding more commentary 2024-10-16 19:32:01 +03:00
Karim shoair a01cfe66db Version 0.1.2
Check the changelog in releases
2024-10-16 18:21:56 +03:00
Karim shoair f0a21f6f38 Minor fixes 2024-10-14 03:19:27 +03:00
Karim shoair c89fc88f5e Another Compatibility fix for Python 3.7 because I deserve 2024-10-14 00:37:15 +03:00
Karim shoair 227d52a86b Compatibility fix for Python 3.7 2024-10-14 00:35:15 +03:00
Karim shoair c85fabb581 Handle importing Protocol in Python 3.6 and 3.7 2024-10-14 00:19:49 +03:00
Karim shoair 84b0ea6121 Handle importing SupportsIndex in Python 3.6 and 3.7 2024-10-14 00:04:36 +03:00
Karim shoair a721073b7c Going online (first public version) 2024-10-13 23:38:48 +03:00