Karim shoair
21291958f1
docs(README file): Better more-friendly description
2025-01-28 23:10:56 +02:00
Karim shoair
0e1dcd4f29
Adding Scrapeless sponsor
2025-01-06 11:59:19 +02:00
Karim shoair
ef284234e6
docs: update README file to reflect new installation instructions
2024-12-26 19:56:37 +02:00
Karim shoair
ac95600650
docs: add an example that uses page.urljoin
2024-12-16 13:27:14 +02:00
Karim shoair
43b41b3733
docs: fix TOC header
2024-12-16 12:41:07 +02:00
Karim shoair
6cf5ce9719
docs: Adding async examples and fixing some typos
2024-12-16 12:39:44 +02:00
Karim shoair
299793af3f
feat: adding the retries argument for all methods of Fetcher class
2024-12-15 15:59:15 +02:00
Karim shoair
bfe906315e
feat: adding geoip parameter to the StealthyFetcher
2024-12-12 12:43:49 +02:00
Karim shoair
193827e27b
refactor(api)!: Unifying log under 1 logger and removing debug parameter
...
So now you control the logging and the debugging from the shell through the logger with the name 'scrapling'
2024-12-11 21:41:37 +02:00
Karim shoair
b4f90615c3
Adding keep_cdata argument for Adaptor and Response classes
...
This will force lxml to keep cdata while parsing html if you want
2024-12-10 22:06:08 +02:00
Karim shoair
d0f18951ac
fix: Enable WebGL by default
2024-12-04 23:38:30 +02:00
Karim shoair
82f8e4a073
Fixing import typo, thanks to #20
2024-11-30 11:23:07 +02:00
Karim shoair
f8ad18ab8a
Rephrasing some parts to be clearer
2024-11-27 11:50:20 +02:00
Karim shoair
ccf38606d8
Making the README clearer a bit
2024-11-26 21:25:16 +02:00
Karim shoair
dbd674aa7c
Adding proxy support for basic requests
2024-11-26 21:24:41 +02:00
Karim shoair
d6a59774ea
StealthyFetcher - The option to disable ads with ublock origin addon
2024-11-26 20:23:02 +02:00
Karim shoair
60d551d839
PlaywrightFetcher - Add the option to set locale of the browser
2024-11-26 17:39:03 +02:00
Karim shoair
468d9b8f63
Update README.md
2024-11-25 12:28:06 +02:00
Karim shoair
1ab0f74cce
Updating SerpApi Logo
2024-11-25 12:26:19 +02:00
Karim shoair
cdc7ed8fa8
Removing CapSolver
2024-11-25 11:26:42 +02:00
Karim shoair
12d638ac2e
Updating the doc to reflect new changes
2024-11-24 15:20:18 +02:00
Karim shoair
0c6e7708d1
Update README.md
2024-11-16 21:55:53 +02:00
Karim shoair
d8a8af8d05
Updating the README to reflect new changes
2024-11-16 21:29:05 +02:00
Karim shoair
105ec5b067
Update README.md
2024-11-15 23:18:02 +02:00
Karim shoair
e2a64a0707
Adding SerpApi as a sponsor
2024-11-15 23:07:59 +02:00
Karim shoair
5e8275c3eb
Adding the option to randomize the OS fingerprints with the StealthyFetcher
2024-11-15 16:36:32 +02:00
Karim shoair
2abb70218f
Adding the proxy support to browser-based Fetchers
2024-11-15 14:43:03 +02:00
Karim shoair
b993adb4a7
Rephrasing some parts
2024-11-15 11:26:41 +02:00
Karim shoair
ae7959b4a4
Update README.md
2024-11-15 02:50:24 +02:00
Karim shoair
c334755377
Reflecting the new changes in the README and adding small notes
2024-11-15 02:33:47 +02:00
Karim shoair
9e337251ca
Update README.md
2024-11-14 16:09:05 +02:00
Karim shoair
e7e9cf8b3d
Adding Evomi as a sponsor
2024-11-14 16:05:37 +02:00
Karim shoair
b9c64e8dbf
Update and rename README.md to Adding Evomi as a sponsor
2024-11-14 16:04:48 +02:00
Karim shoair
64c9fe905e
Corrections and rephrasing
2024-11-11 16:40:54 +02:00
Karim shoair
79bf4060f4
Updating find_all examples
2024-11-11 12:51:40 +02:00
Karim shoair
e8935b1af8
Update README.md
2024-11-10 23:45:48 +02:00
Karim shoair
7d2f55bd4c
First version of the 0.2 README
...
I probably forgot some features and made some mistakes here and there so I will review it again later
2024-11-10 00:09:30 +02:00
Karim shoair
3622040440
Adding css_first and xpath_first for easier usage
2024-11-05 23:41:51 +02:00
Karim shoair
0867d9e78a
Update README.md
2024-11-03 14:48:33 +02:00
Karim shoair
263236a302
Update README.md
2024-11-03 12:42:26 +02:00
Karim shoair
26265327b5
Adding the option to update browserforge with camoufox
...
Since my PRs to Camoufox got accepted 🚬
2024-11-03 12:24:52 +02:00
Karim shoair
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00
Karim shoair
088334b40b
Reflecting the new changes in the ReadMe for testers
2024-10-31 02:16:09 +03:00
Karim shoair
b45cb4146b
Making documentations/templates URLs complete instead of relative
...
For representations on other websites
2024-10-16 21:32:47 +03:00
Karim shoair
a01cfe66db
Version 0.1.2
...
Check the changelog in releases
2024-10-16 18:21:56 +03:00
Karim shoair
3b27502797
Update README.md
2024-10-14 03:01:26 +03:00
Karim shoair
8d03f8a709
Update README.md
2024-10-14 01:23:46 +03:00
Karim shoair
b7ab7f31e7
Removing support of Python 3.6
...
Sorry I tried
2024-10-14 00:45:09 +03:00
Karim shoair
a721073b7c
Going online (first public version)
2024-10-13 23:38:48 +03:00