Commit Graph

65 Commits

Author SHA1 Message Date
Karim shoair 3af174526f PlayWright Engine - Doc strings and type annotations stuff 2024-11-03 22:24:44 +02:00
Karim shoair 54cacb8a4e Camoufox Engine - Doc strings and type annotations stuff 2024-11-03 22:20:29 +02:00
Karim shoair 61fd592a6a Adding documentation to PlaywrightFetcher class 2024-11-03 21:04:11 +02:00
Karim shoair c1575b8e2e Updating doc-strings for more clarity 2024-11-03 16:49:33 +02:00
Karim shoair 1d2c68125a Update fetcher.py 2024-11-03 16:40:42 +02:00
Karim shoair 3556d11fb2 StealthyFetcher - Add disable_resources option and its explanation 2024-11-03 16:33:08 +02:00
Karim shoair 711de81106 PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost 2024-11-03 16:27:55 +02:00
Karim shoair b32e1203f2 StealthyFetcher - The option to drop unnecessary resources requests for speed boost 2024-11-03 16:27:32 +02:00
Karim shoair c8c494e73f Adding a function to intercept and drop unwanted requests 2024-11-03 16:25:55 +02:00
Karim shoair 0867d9e78a Update README.md 2024-11-03 14:48:33 +02:00
Karim shoair e7e499d64b Add documentation for StealthyFetcher class + add webgl option 2024-11-03 14:45:20 +02:00
Karim shoair e7300ecba0 StealthFetcher - Add the option to allow webgl in the browser 2024-11-03 14:40:19 +02:00
Karim shoair 2528d4e023 Add documentation for the Fetcher class 2024-11-03 14:39:24 +02:00
Karim shoair be350f21dd Adding documentation to the base fetcher...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
Karim shoair 55ab1d63b7 Turn auto_match off when not needed in testing 2024-11-03 13:37:27 +02:00
Karim shoair eaae5908c9 Make auto_match enabled by default 2024-11-03 13:33:24 +02:00
Karim shoair a0022f7322 Pumping up camoufox version
Now, all progress bars are hidden
2024-11-03 13:20:00 +02:00
Karim shoair 1ff1c93bcf Give response's body bytes priority over response's text 2024-11-03 13:04:02 +02:00
Karim shoair afe53332b8 Convert the request headers to dictionary to unify response object shape across engines 2024-11-03 13:01:48 +02:00
Karim shoair 942aa08c85 Handling JSON responses better 2024-11-03 13:00:23 +02:00
Karim shoair d845cae816 Update CONTRIBUTING.md 2024-11-03 12:42:53 +02:00
Karim shoair 263236a302 Update README.md 2024-11-03 12:42:26 +02:00
Karim shoair 26265327b5 Adding the option to update browserforge with camoufox
Since my PRs to Camoufox got accepted 🚬
2024-11-03 12:24:52 +02:00
Karim shoair 145c03daff Big structure changes (check commit description)
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
Karim shoair 7f1c06e7bf Pumping camoufox version up 2024-11-02 21:19:13 +02:00
Karim shoair 78c718c1d2 I don't know how that happened! 2024-11-02 21:17:56 +02:00
Karim shoair 088334b40b Reflecting the new changes in the ReadMe for testers 2024-10-31 02:16:09 +03:00
Karim shoair be2847ffb8 Bumping the library for version 0.2 for now and more adjustments 2024-10-31 02:14:41 +03:00
Karim shoair 3cb1696d6c Adding the main fetcher file to use for fetching pages 2024-10-31 02:13:35 +03:00
Karim shoair aadae4a25b Adding the JavaScript bypasses files for stealth mode 2024-10-31 02:12:37 +03:00
Karim shoair 8f8d08b568 Adding browsing engines 2024-10-31 02:11:33 +03:00
Karim shoair 6eeca3daa7 Going back to single utils file and using the new types file 2024-10-31 01:32:53 +03:00
Karim shoair 23c4181ff2 Using the new types file 2024-10-31 01:32:18 +03:00
Karim shoair 1ca2b6cfe4 Combing type definitions in one file 2024-10-31 01:31:10 +03:00
Karim shoair e485d51b43 Update ROADMAP.md 2024-10-31 01:16:38 +03:00
Karim shoair 427f43eb96 Update MANIFEST.in 2024-10-31 01:15:41 +03:00
Karim shoair 327281c664 Making structure clearer to help with the next version 2024-10-26 21:32:57 +03:00
Karim shoair 878fe0d373 Update CONTRIBUTING.md 2024-10-26 21:31:57 +03:00
Karim shoair 7515f803bc Be more specific about tests 2024-10-26 21:31:31 +03:00
Karim shoair 231aeb0616 Dropping Python 3.7 from the tests for next version 2024-10-26 21:30:44 +03:00
Karim shoair b45cb4146b Making documentations/templates URLs complete instead of relative
For representations on other websites
2024-10-16 21:32:47 +03:00
Karim shoair 4ca41c9dd8 Small adjustment to stackoverflow example 2024-10-16 19:32:37 +03:00
Karim shoair d546b3499b Handling an edge case and adding more commentary 2024-10-16 19:32:01 +03:00
Karim shoair a01cfe66db Version 0.1.2
Check the changelog in releases
2024-10-16 18:21:56 +03:00
Karim shoair f0a21f6f38 Minor fixes 2024-10-14 03:19:27 +03:00
Karim shoair 327e7189bc fix
Damn I need to sleep
2024-10-14 03:04:49 +03:00
Karim shoair 3b27502797 Update README.md 2024-10-14 03:01:26 +03:00
Karim shoair 8b6313221f Update publish.yml 2024-10-14 02:59:15 +03:00
Karim shoair 2863511f1f Add one more trigger to the publish workflow 2024-10-14 02:56:20 +03:00
Karim shoair 521b27d231 Update setup.py 2024-10-14 02:53:21 +03:00