80cc0b77f3
Update tests.yml
2024-11-05 02:31:34 +02:00
4121fe73c9
Update tests.yml
2024-11-05 02:27:30 +02:00
72b36d6a26
Fix werkzeug issue and try caching
2024-11-05 02:22:21 +02:00
a5ffc0be5d
Update tests.yml
2024-11-05 02:09:32 +02:00
7fd50a4b94
Update tests.yml
2024-11-05 02:06:45 +02:00
3b25a248fc
Fixing tests action
2024-11-05 02:04:49 +02:00
e594bba0c4
Testing some of the new tests on Github action
2024-11-05 01:19:50 +02:00
bd612bb0e2
Updating the disable_resources doc-string
2024-11-04 20:16:04 +02:00
544d23b696
Toolbelt fingerprint functions - Doc strings and type annotations stuff
2024-11-03 23:31:09 +02:00
e270b00811
Toolbelt subpackage custom functions general adjustments
2024-11-03 23:17:20 +02:00
2ff0fbb0e5
Engines utils - Navigation functions
...
- Adding doc strings and type annotations stuff.
- Making error messages more detailed.
- Renaming the `construct_websocket_url` function for more clarity.
2024-11-03 22:46:40 +02:00
b8afb390ae
Renaming fetcher file to fetchers for clarity
2024-11-03 22:43:16 +02:00
282b130864
Static Engine - Doc strings and type annotations stuff
2024-11-03 22:25:34 +02:00
3af174526f
PlayWright Engine - Doc strings and type annotations stuff
2024-11-03 22:24:44 +02:00
54cacb8a4e
Camoufox Engine - Doc strings and type annotations stuff
2024-11-03 22:20:29 +02:00
61fd592a6a
Adding documentation to PlaywrightFetcher class
2024-11-03 21:04:11 +02:00
c1575b8e2e
Updating doc-strings for more clarity
2024-11-03 16:49:33 +02:00
1d2c68125a
Update fetcher.py
2024-11-03 16:40:42 +02:00
3556d11fb2
StealthyFetcher - Add disable_resources option and its explanation
2024-11-03 16:33:08 +02:00
711de81106
PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost
2024-11-03 16:27:55 +02:00
b32e1203f2
StealthyFetcher - The option to drop unnecessary resources requests for speed boost
2024-11-03 16:27:32 +02:00
c8c494e73f
Adding a function to intercept and drop unwanted requests
2024-11-03 16:25:55 +02:00
0867d9e78a
Update README.md
2024-11-03 14:48:33 +02:00
e7e499d64b
Add documentation for StealthyFetcher class + add webgl option
2024-11-03 14:45:20 +02:00
e7300ecba0
StealthFetcher - Add the option to allow webgl in the browser
2024-11-03 14:40:19 +02:00
2528d4e023
Add documentation for the Fetcher class
2024-11-03 14:39:24 +02:00
be350f21dd
Adding documentation to the base fetcher...
...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
55ab1d63b7
Turn auto_match off when not needed in testing
2024-11-03 13:37:27 +02:00
eaae5908c9
Make auto_match enabled by default
2024-11-03 13:33:24 +02:00
a0022f7322
Pumping up camoufox version
...
Now, all progress bars are hidden
2024-11-03 13:20:00 +02:00
1ff1c93bcf
Give response's body bytes priority over response's text
2024-11-03 13:04:02 +02:00
afe53332b8
Convert the request headers to dictionary to unify response object shape across engines
2024-11-03 13:01:48 +02:00
942aa08c85
Handling JSON responses better
2024-11-03 13:00:23 +02:00
d845cae816
Update CONTRIBUTING.md
2024-11-03 12:42:53 +02:00
263236a302
Update README.md
2024-11-03 12:42:26 +02:00
26265327b5
Adding the option to update browserforge with camoufox
...
Since my PRs to Camoufox got accepted 🚬
2024-11-03 12:24:52 +02:00
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
7f1c06e7bf
Pumping camoufox version up
2024-11-02 21:19:13 +02:00
78c718c1d2
I don't know how that happened!
2024-11-02 21:17:56 +02:00
088334b40b
Reflecting the new changes in the ReadMe for testers
2024-10-31 02:16:09 +03:00
be2847ffb8
Bumping the library for version 0.2 for now and more adjustments
2024-10-31 02:14:41 +03:00
3cb1696d6c
Adding the main fetcher file to use for fetching pages
2024-10-31 02:13:35 +03:00
aadae4a25b
Adding the JavaScript bypasses files for stealth mode
2024-10-31 02:12:37 +03:00
8f8d08b568
Adding browsing engines
2024-10-31 02:11:33 +03:00
6eeca3daa7
Going back to single utils file and using the new types file
2024-10-31 01:32:53 +03:00
23c4181ff2
Using the new types file
2024-10-31 01:32:18 +03:00
1ca2b6cfe4
Combing type definitions in one file
2024-10-31 01:31:10 +03:00
e485d51b43
Update ROADMAP.md
2024-10-31 01:16:38 +03:00
427f43eb96
Update MANIFEST.in
2024-10-31 01:15:41 +03:00
327281c664
Making structure clearer to help with the next version
2024-10-26 21:32:57 +03:00
Karim shoair