Karim shoair
1b015bbd07
Type correction
2024-11-08 23:59:12 +02:00
Karim shoair
a0a3e62075
Adding addons and humanize arguments to StealthyFetcher
2024-11-06 20:14:42 +02:00
Karim shoair
5ad2126030
Small speed boost for fetching by some caching
2024-11-06 19:56:39 +02:00
Karim shoair
10bcdfb596
Moving bypasses folder deeper
2024-11-06 12:19:26 +02:00
Karim shoair
6cf506cb22
PlaywrightEngine - Validate CDP URLs in all cases
2024-11-06 11:24:56 +02:00
Karim shoair
6497b1b559
Type correction
2024-11-06 02:20:33 +02:00
Karim shoair
a60662af4a
Update camo.py
2024-11-05 11:38:35 +02:00
Karim shoair
bd612bb0e2
Updating the disable_resources doc-string
2024-11-04 20:16:04 +02:00
Karim shoair
544d23b696
Toolbelt fingerprint functions - Doc strings and type annotations stuff
2024-11-03 23:31:09 +02:00
Karim shoair
e270b00811
Toolbelt subpackage custom functions general adjustments
2024-11-03 23:17:20 +02:00
Karim shoair
2ff0fbb0e5
Engines utils - Navigation functions
...
- Adding doc strings and type annotations stuff.
- Making error messages more detailed.
- Renaming the `construct_websocket_url` function for more clarity.
2024-11-03 22:46:40 +02:00
Karim shoair
282b130864
Static Engine - Doc strings and type annotations stuff
2024-11-03 22:25:34 +02:00
Karim shoair
3af174526f
PlayWright Engine - Doc strings and type annotations stuff
2024-11-03 22:24:44 +02:00
Karim shoair
54cacb8a4e
Camoufox Engine - Doc strings and type annotations stuff
2024-11-03 22:20:29 +02:00
Karim shoair
711de81106
PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost
2024-11-03 16:27:55 +02:00
Karim shoair
b32e1203f2
StealthyFetcher - The option to drop unnecessary resources requests for speed boost
2024-11-03 16:27:32 +02:00
Karim shoair
c8c494e73f
Adding a function to intercept and drop unwanted requests
2024-11-03 16:25:55 +02:00
Karim shoair
e7300ecba0
StealthFetcher - Add the option to allow webgl in the browser
2024-11-03 14:40:19 +02:00
Karim shoair
be350f21dd
Adding documentation to the base fetcher...
...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
Karim shoair
1ff1c93bcf
Give response's body bytes priority over response's text
2024-11-03 13:04:02 +02:00
Karim shoair
afe53332b8
Convert the request headers to dictionary to unify response object shape across engines
2024-11-03 13:01:48 +02:00
Karim shoair
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
Karim shoair
aadae4a25b
Adding the JavaScript bypasses files for stealth mode
2024-10-31 02:12:37 +03:00
Karim shoair
8f8d08b568
Adding browsing engines
2024-10-31 02:11:33 +03:00