Commit Graph

7 Commits

Author SHA1 Message Date
Karim shoair c1575b8e2e Updating doc-strings for more clarity 2024-11-03 16:49:33 +02:00
Karim shoair 1d2c68125a Update fetcher.py 2024-11-03 16:40:42 +02:00
Karim shoair 3556d11fb2 StealthyFetcher - Add disable_resources option and its explanation 2024-11-03 16:33:08 +02:00
Karim shoair e7e499d64b Add documentation for StealthyFetcher class + add webgl option 2024-11-03 14:45:20 +02:00
Karim shoair 2528d4e023 Add documentation for the Fetcher class 2024-11-03 14:39:24 +02:00
Karim shoair 145c03daff Big structure changes (check commit description)
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
Karim shoair 3cb1696d6c Adding the main fetcher file to use for fetching pages 2024-10-31 02:13:35 +03:00