Karim shoair
1929d9bebb
Fix for docs
2024-11-23 17:48:05 +02:00
Karim shoair
073ab2c7e3
Universally handling different response encoding and charsets for all responses
...
Thanks for @andyfcx
2024-11-23 15:40:41 +02:00
Karim shoair
19ad82caef
Calculate status text manually if it's not returned by PlayWright API
2024-11-20 13:27:18 +02:00
Karim shoair
b60ac7f56a
Change debug mode to be off by default
2024-11-16 21:11:58 +02:00
Karim shoair
572df6b3b4
Fixing the way Response object handles sub items in some edge cases
...
+ Do it with the least impact on performance
2024-11-16 13:54:55 +02:00
Karim shoair
095d50cd75
Making the Response returned from all fetchers same as Adaptor object
...
but with added attributes
2024-11-15 02:23:14 +02:00
Karim shoair
239e2c73bf
Correctly get page content after JS Execution
...
- Thanks for @AbdullahY36 for the heads-up.
**Update reference** https://developer.mozilla.org/en-US/docs/Web/API/Document/DOMContentLoaded_event
2024-11-10 16:11:46 +02:00
Karim shoair
b90c8adb02
Adding the argument automatch_domain to all fetchers
2024-11-09 15:38:27 +02:00
Karim shoair
e270b00811
Toolbelt subpackage custom functions general adjustments
2024-11-03 23:17:20 +02:00
Karim shoair
be350f21dd
Adding documentation to the base fetcher...
...
+ Configure logger from here.
+ Enable auto_match by default.
2024-11-03 13:45:13 +02:00
Karim shoair
1ff1c93bcf
Give response's body bytes priority over response's text
2024-11-03 13:04:02 +02:00
Karim shoair
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00