b32e1203f2
StealthyFetcher - The option to drop unnecessary resources requests for speed boost
2024-11-03 16:27:32 +02:00
c8c494e73f
Adding a function to intercept and drop unwanted requests
2024-11-03 16:25:55 +02:00
e7e499d64b
Add documentation for StealthyFetcher class + add webgl option
2024-11-03 14:45:20 +02:00
e7300ecba0
StealthFetcher - Add the option to allow webgl in the browser
2024-11-03 14:40:19 +02:00
2528d4e023
Add documentation for the Fetcher class
2024-11-03 14:39:24 +02:00
be350f21dd
Adding documentation to the base fetcher...
...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
eaae5908c9
Make auto_match enabled by default
2024-11-03 13:33:24 +02:00
1ff1c93bcf
Give response's body bytes priority over response's text
2024-11-03 13:04:02 +02:00
afe53332b8
Convert the request headers to dictionary to unify response object shape across engines
2024-11-03 13:01:48 +02:00
942aa08c85
Handling JSON responses better
2024-11-03 13:00:23 +02:00
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
78c718c1d2
I don't know how that happened!
2024-11-02 21:17:56 +02:00
be2847ffb8
Bumping the library for version 0.2 for now and more adjustments
2024-10-31 02:14:41 +03:00
3cb1696d6c
Adding the main fetcher file to use for fetching pages
2024-10-31 02:13:35 +03:00
aadae4a25b
Adding the JavaScript bypasses files for stealth mode
2024-10-31 02:12:37 +03:00
8f8d08b568
Adding browsing engines
2024-10-31 02:11:33 +03:00
6eeca3daa7
Going back to single utils file and using the new types file
2024-10-31 01:32:53 +03:00
23c4181ff2
Using the new types file
2024-10-31 01:32:18 +03:00
1ca2b6cfe4
Combing type definitions in one file
2024-10-31 01:31:10 +03:00
327281c664
Making structure clearer to help with the next version
2024-10-26 21:32:57 +03:00
d546b3499b
Handling an edge case and adding more commentary
2024-10-16 19:32:01 +03:00
a01cfe66db
Version 0.1.2
...
Check the changelog in releases
2024-10-16 18:21:56 +03:00
f0a21f6f38
Minor fixes
2024-10-14 03:19:27 +03:00
c89fc88f5e
Another Compatibility fix for Python 3.7 because I deserve
2024-10-14 00:37:15 +03:00
227d52a86b
Compatibility fix for Python 3.7
2024-10-14 00:35:15 +03:00
c85fabb581
Handle importing Protocol in Python 3.6 and 3.7
2024-10-14 00:19:49 +03:00
84b0ea6121
Handle importing SupportsIndex in Python 3.6 and 3.7
2024-10-14 00:04:36 +03:00
a721073b7c
Going online (first public version)
2024-10-13 23:38:48 +03:00
Karim shoair