Commit Graph

44 Commits

Author SHA1 Message Date
Karim shoair 6cf5ce9719 docs: Adding async examples and fixing some typos 2024-12-16 12:39:44 +02:00
Karim shoair 299793af3f feat: adding the retries argument for all methods of Fetcher class 2024-12-15 15:59:15 +02:00
Karim shoair bfe906315e feat: adding geoip parameter to the StealthyFetcher 2024-12-12 12:43:49 +02:00
Karim shoair 193827e27b refactor(api)!: Unifying log under 1 logger and removing debug parameter
So now you control the logging and the debugging from the shell through the logger with the name 'scrapling'
2024-12-11 21:41:37 +02:00
Karim shoair b4f90615c3 Adding keep_cdata argument for Adaptor and Response classes
This will force lxml to keep cdata while parsing html if you want
2024-12-10 22:06:08 +02:00
Karim shoair d0f18951ac fix: Enable WebGL by default 2024-12-04 23:38:30 +02:00
Karim shoair 82f8e4a073 Fixing import typo, thanks to #20 2024-11-30 11:23:07 +02:00
Karim shoair f8ad18ab8a Rephrasing some parts to be clearer 2024-11-27 11:50:20 +02:00
Karim shoair ccf38606d8 Making the README clearer a bit 2024-11-26 21:25:16 +02:00
Karim shoair dbd674aa7c Adding proxy support for basic requests 2024-11-26 21:24:41 +02:00
Karim shoair d6a59774ea StealthyFetcher - The option to disable ads with ublock origin addon 2024-11-26 20:23:02 +02:00
Karim shoair 60d551d839 PlaywrightFetcher - Add the option to set locale of the browser 2024-11-26 17:39:03 +02:00
Karim shoair 468d9b8f63 Update README.md 2024-11-25 12:28:06 +02:00
Karim shoair 1ab0f74cce Updating SerpApi Logo 2024-11-25 12:26:19 +02:00
Karim shoair cdc7ed8fa8 Removing CapSolver 2024-11-25 11:26:42 +02:00
Karim shoair 12d638ac2e Updating the doc to reflect new changes 2024-11-24 15:20:18 +02:00
Karim shoair 0c6e7708d1 Update README.md 2024-11-16 21:55:53 +02:00
Karim shoair d8a8af8d05 Updating the README to reflect new changes 2024-11-16 21:29:05 +02:00
Karim shoair 105ec5b067 Update README.md 2024-11-15 23:18:02 +02:00
Karim shoair e2a64a0707 Adding SerpApi as a sponsor 2024-11-15 23:07:59 +02:00
Karim shoair 5e8275c3eb Adding the option to randomize the OS fingerprints with the StealthyFetcher 2024-11-15 16:36:32 +02:00
Karim shoair 2abb70218f Adding the proxy support to browser-based Fetchers 2024-11-15 14:43:03 +02:00
Karim shoair b993adb4a7 Rephrasing some parts 2024-11-15 11:26:41 +02:00
Karim shoair ae7959b4a4 Update README.md 2024-11-15 02:50:24 +02:00
Karim shoair c334755377 Reflecting the new changes in the README and adding small notes 2024-11-15 02:33:47 +02:00
Karim shoair 9e337251ca Update README.md 2024-11-14 16:09:05 +02:00
Karim shoair e7e9cf8b3d Adding Evomi as a sponsor 2024-11-14 16:05:37 +02:00
Karim shoair b9c64e8dbf Update and rename README.md to Adding Evomi as a sponsor 2024-11-14 16:04:48 +02:00
Karim shoair 64c9fe905e Corrections and rephrasing 2024-11-11 16:40:54 +02:00
Karim shoair 79bf4060f4 Updating find_all examples 2024-11-11 12:51:40 +02:00
Karim shoair e8935b1af8 Update README.md 2024-11-10 23:45:48 +02:00
Karim shoair 7d2f55bd4c First version of the 0.2 README
I probably forgot some features and made some mistakes here and there so I will review it again later
2024-11-10 00:09:30 +02:00
Karim shoair 3622040440 Adding css_first and xpath_first for easier usage 2024-11-05 23:41:51 +02:00
Karim shoair 0867d9e78a Update README.md 2024-11-03 14:48:33 +02:00
Karim shoair 263236a302 Update README.md 2024-11-03 12:42:26 +02:00
Karim shoair 26265327b5 Adding the option to update browserforge with camoufox
Since my PRs to Camoufox got accepted 🚬
2024-11-03 12:24:52 +02:00
Karim shoair 145c03daff Big structure changes (check commit description)
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
Karim shoair 088334b40b Reflecting the new changes in the ReadMe for testers 2024-10-31 02:16:09 +03:00
Karim shoair b45cb4146b Making documentations/templates URLs complete instead of relative
For representations on other websites
2024-10-16 21:32:47 +03:00
Karim shoair a01cfe66db Version 0.1.2
Check the changelog in releases
2024-10-16 18:21:56 +03:00
Karim shoair 3b27502797 Update README.md 2024-10-14 03:01:26 +03:00
Karim shoair 8d03f8a709 Update README.md 2024-10-14 01:23:46 +03:00
Karim shoair b7ab7f31e7 Removing support of Python 3.6
Sorry I tried
2024-10-14 00:45:09 +03:00
Karim shoair a721073b7c Going online (first public version) 2024-10-13 23:38:48 +03:00