Commit Graph

99 Commits

Author SHA1 Message Date
Karim shoair 10bcdfb596 Moving bypasses folder deeper 2024-11-06 12:19:26 +02:00
Karim shoair 6cf506cb22 PlaywrightEngine - Validate CDP URLs in all cases 2024-11-06 11:24:56 +02:00
Karim shoair 6497b1b559 Type correction 2024-11-06 02:20:33 +02:00
Karim shoair 24806aecdc Update .gitignore 2024-11-05 23:41:57 +02:00
Karim shoair 3622040440 Adding css_first and xpath_first for easier usage 2024-11-05 23:41:51 +02:00
Karim shoair 009c2914aa Fixing re_first logic in Adaptors type 2024-11-05 22:59:47 +02:00
Karim shoair d50497dff3 Update .gitignore 2024-11-05 22:56:57 +02:00
Karim shoair ca4b5f205c Since tests can finally now run in Github actions without issues
Let's miss it up again lol
2024-11-05 13:10:51 +02:00
Karim shoair 2a275c436c Update tests.yml 2024-11-05 13:02:11 +02:00
Karim shoair 69cfbe45be Update tests.yml 2024-11-05 12:59:39 +02:00
Karim shoair 6f91d06b46 Update tests.yml 2024-11-05 12:57:57 +02:00
Karim shoair 2020214784 please work 2024-11-05 11:45:59 +02:00
Karim shoair 92d002032d Update tests.yml 2024-11-05 11:44:10 +02:00
Karim shoair 1bbb5dd75a Update tests.yml 2024-11-05 11:41:58 +02:00
Karim shoair d4358d32a8 Update tests.yml 2024-11-05 11:38:38 +02:00
Karim shoair a60662af4a Update camo.py 2024-11-05 11:38:35 +02:00
Karim shoair 8933a99a6e Update tests.yml 2024-11-05 11:29:28 +02:00
Karim shoair f200e9b290 looks like playwright need to run as normal user 2024-11-05 11:28:12 +02:00
Karim shoair 1dd04f8250 Update tests.yml 2024-11-05 02:39:15 +02:00
Karim shoair 6f7d925a2a Revert "Update tests.yml"
This reverts commit 33f44587e6.
2024-11-05 02:34:43 +02:00
Karim shoair 33f44587e6 Update tests.yml 2024-11-05 02:33:21 +02:00
Karim shoair 80cc0b77f3 Update tests.yml 2024-11-05 02:31:34 +02:00
Karim shoair 4121fe73c9 Update tests.yml 2024-11-05 02:27:30 +02:00
Karim shoair 72b36d6a26 Fix werkzeug issue and try caching 2024-11-05 02:22:21 +02:00
Karim shoair a5ffc0be5d Update tests.yml 2024-11-05 02:09:32 +02:00
Karim shoair 7fd50a4b94 Update tests.yml 2024-11-05 02:06:45 +02:00
Karim shoair 3b25a248fc Fixing tests action 2024-11-05 02:04:49 +02:00
Karim shoair e594bba0c4 Testing some of the new tests on Github action 2024-11-05 01:19:50 +02:00
Karim shoair bd612bb0e2 Updating the disable_resources doc-string 2024-11-04 20:16:04 +02:00
Karim shoair 544d23b696 Toolbelt fingerprint functions - Doc strings and type annotations stuff 2024-11-03 23:31:09 +02:00
Karim shoair e270b00811 Toolbelt subpackage custom functions general adjustments 2024-11-03 23:17:20 +02:00
Karim shoair 2ff0fbb0e5 Engines utils - Navigation functions
- Adding doc strings and type annotations stuff.
- Making error messages more detailed.
- Renaming the `construct_websocket_url` function for more clarity.
2024-11-03 22:46:40 +02:00
Karim shoair b8afb390ae Renaming fetcher file to fetchers for clarity 2024-11-03 22:43:16 +02:00
Karim shoair 282b130864 Static Engine - Doc strings and type annotations stuff 2024-11-03 22:25:34 +02:00
Karim shoair 3af174526f PlayWright Engine - Doc strings and type annotations stuff 2024-11-03 22:24:44 +02:00
Karim shoair 54cacb8a4e Camoufox Engine - Doc strings and type annotations stuff 2024-11-03 22:20:29 +02:00
Karim shoair 61fd592a6a Adding documentation to PlaywrightFetcher class 2024-11-03 21:04:11 +02:00
Karim shoair c1575b8e2e Updating doc-strings for more clarity 2024-11-03 16:49:33 +02:00
Karim shoair 1d2c68125a Update fetcher.py 2024-11-03 16:40:42 +02:00
Karim shoair 3556d11fb2 StealthyFetcher - Add disable_resources option and its explanation 2024-11-03 16:33:08 +02:00
Karim shoair 711de81106 PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost 2024-11-03 16:27:55 +02:00
Karim shoair b32e1203f2 StealthyFetcher - The option to drop unnecessary resources requests for speed boost 2024-11-03 16:27:32 +02:00
Karim shoair c8c494e73f Adding a function to intercept and drop unwanted requests 2024-11-03 16:25:55 +02:00
Karim shoair 0867d9e78a Update README.md 2024-11-03 14:48:33 +02:00
Karim shoair e7e499d64b Add documentation for StealthyFetcher class + add webgl option 2024-11-03 14:45:20 +02:00
Karim shoair e7300ecba0 StealthFetcher - Add the option to allow webgl in the browser 2024-11-03 14:40:19 +02:00
Karim shoair 2528d4e023 Add documentation for the Fetcher class 2024-11-03 14:39:24 +02:00
Karim shoair be350f21dd Adding documentation to the base fetcher...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
Karim shoair 55ab1d63b7 Turn auto_match off when not needed in testing 2024-11-03 13:37:27 +02:00
Karim shoair eaae5908c9 Make auto_match enabled by default 2024-11-03 13:33:24 +02:00