 Karim shoair
|
fc42487a5f
|
refactor(controllers): Optimize imports
|
2025-06-22 18:53:44 +03:00 |
|
|
Karim shoair
|
9c44ad1930
|
fix(AsyncFetcher): Fix stealthy_headers issue
|
2025-06-22 03:54:36 +03:00 |
|
|
Karim shoair
|
b77c5b7abf
|
refactor: updating top level shortcuts
|
2025-06-22 02:11:26 +03:00 |
|
|
Karim shoair
|
8a272cf19b
|
feat/refactor(fetchers): Replacing PlayWrightFetcher with DynamicFetcher and adding session classes
|
2025-06-22 02:10:45 +03:00 |
|
|
Karim shoair
|
1e51fc9738
|
refactor: Removing defaults as said
|
2025-06-22 02:07:34 +03:00 |
|
|
Karim shoair
|
0a570a7ca7
|
docs: Updating doc strings
|
2025-06-22 01:59:38 +03:00 |
|
|
Karim shoair
|
d049f63404
|
fix(fetcher): Fix impersonate and headers generation conflict
|
2025-06-20 03:29:05 +03:00 |
|
|
Karim shoair
|
9bfc900140
|
feat(navigation tools): Improvements
|
2025-06-19 04:07:45 +03:00 |
|
|
Karim shoair
|
145b710960
|
feat(fetchers): Adding the foundation of the new browser-based fetchers logic
|
2025-06-19 04:06:52 +03:00 |
|
|
Karim shoair
|
3e63fa2523
|
fix(shell): Hide the automatic tips and solve the namespace issue
|
2025-06-19 04:03:13 +03:00 |
|
|
Karim shoair
|
2bdee60004
|
fix(fingerprints): Fixing headers generation for requests
|
2025-06-15 03:37:22 +03:00 |
|
|
Karim shoair
|
1f34ac22f6
|
style(fetcher): Move the default UA line
|
2025-06-15 03:21:21 +03:00 |
|
|
Karim shoair
|
7efbcd33c3
|
refactor(fingerprints): Remove unused function and improve another
|
2025-06-15 03:16:27 +03:00 |
|
|
Karim shoair
|
6e837f6a12
|
refactor(StealthyFetcher): Improve OS name extraction
|
2025-06-14 18:57:31 +03:00 |
|
|
Karim shoair
|
3068bb1356
|
build: update deps
|
2025-06-14 18:56:31 +03:00 |
|
|
Karim shoair
|
178eed7533
|
feat/fix(Fetcher): Adding http3 support + Fix stealthy_headers
And some fixes here and there to the docs
|
2025-05-31 03:35:46 +03:00 |
|
|
Karim shoair
|
c46ca8873f
|
refactor(fetchers): Optimizing fetchers + making PlayWrightFetcher 10% faster
Check out the Discord server for full details
|
2025-05-25 21:14:24 +03:00 |
|
|
Karim shoair
|
9e68e60161
|
feat(Fetcher): Replacing httpx + Adding FetcherSession
Check out the discord server for details
|
2025-05-25 21:10:20 +03:00 |
|
|
Karim shoair
|
fc535fa208
|
perf: drop w3lib dependency
|
2025-05-11 20:22:15 +03:00 |
|
|
Karim shoair
|
bf72678480
|
feat(cookies): The ability to pass cookies to browser fetchers
|
2025-05-10 19:36:53 +03:00 |
|
|
Karim shoair
|
c84143129e
|
fix(fetchers): Adjusting all cookies returned from each fetcher
The cookies returned now can be passed again to each fetcher's engine without further validation by us.
|
2025-05-10 19:16:34 +03:00 |
|
|
Karim shoair
|
bd47c070aa
|
fix(StealthyFetcher): Adjustments
|
2025-05-10 17:49:03 +03:00 |
|
|
Karim shoair
|
fd33e35ff8
|
feat(StealthyFetcher): adding the option to solve Cloudflare Turnstile
|
2025-05-08 01:08:04 +03:00 |
|
|
Karim shoair
|
6c0b786dea
|
docs(playwrightfetcher): improving docstring
|
2025-05-08 01:04:08 +03:00 |
|
|
Karim shoair
|
74fa1bfbed
|
feat(shell): Add support to curl -b argument
|
2025-04-30 04:23:05 +03:00 |
|
|
Karim shoair
|
8f3b2092c2
|
fix(cli): Update page object after curl request
|
2025-04-29 03:14:41 +03:00 |
|
|
Karim shoair
|
1240ee3eb0
|
fix(Fetcher): Fix the issue of passing cookies
|
2025-04-29 03:01:19 +03:00 |
|
|
Karim shoair
|
98ad50d5aa
|
feat(cli): Adding two new commands (uncurl/curl2fetcher)
|
2025-04-29 02:45:50 +03:00 |
|
|
Karim shoair
|
a9dded34f4
|
fix(install): Fix error with spaces in Python's path (#57)
|
2025-04-26 04:10:38 +03:00 |
|
|
Karim shoair
|
e4bedc779b
|
build: Bumping version up for beta testers
|
2025-04-22 05:17:08 +02:00 |
|
|
Karim shoair
|
49b7ae13f6
|
feat(cli): Adding Scrapling Shell feature
|
2025-04-22 05:15:57 +02:00 |
|
|
Karim shoair
|
0c8dd63f87
|
chore: migrating to ruff and updating pre-commit hooks
|
2025-04-13 17:32:00 +02:00 |
|
|
Karim shoair
|
a79bf3cc9d
|
feat(StealthyFetcher): adding the wait option
This will make fetcher sleep after fetch before closing the page
|
2025-04-08 03:08:48 +02:00 |
|
|
Karim shoair
|
8f5d66f678
|
fix(StealthyFetcher): fix redirection issue with async_fetch
|
2025-04-08 02:58:10 +02:00 |
|
|
Karim shoair
|
d6a3434402
|
fix(PlayWrightFetcher): fix redirection issue with async_fetch
|
2025-04-08 02:57:01 +02:00 |
|
|
Karim shoair
|
128f7b9d6f
|
feat(PlayWrightFetcher): adding the option to sleep after fetch before closing the page
|
2025-04-08 02:54:46 +02:00 |
|
|
Karim shoair
|
eb4ca2c6a4
|
fix(StealthyFetcher): change additional_arguments to a dictionary argument
|
2025-04-08 02:24:43 +02:00 |
|
|
Karim shoair
|
811cd2d9b0
|
refactor: make auto_match disabled by default
|
2025-03-26 19:25:19 +02:00 |
|
|
Karim shoair
|
fec8215631
|
docs: Clearer docs for recent changes
|
2025-03-26 05:56:49 +02:00 |
|
|
Karim shoair
|
7025a7910e
|
build: Pump up the version
|
2025-03-26 05:44:45 +02:00 |
|
|
Karim shoair
|
d33e738c53
|
feat(StealthyFetcher): The ability to pass additional arguments to Camoufox
|
2025-03-26 05:36:05 +02:00 |
|
|
Karim shoair
|
7ca8aaf2df
|
feat(custom_config): The ability to pass custom parser config to requests
|
2025-03-26 03:56:56 +02:00 |
|
|
Karim shoair
|
416bd919ba
|
fix: backward-compatibility with the new import logic
|
2025-03-26 02:49:02 +02:00 |
|
|
Karim shoair
|
7c0c23fd33
|
feat(unified import): Make one import for all fetchers
Why I didn't think of that from the start? IDK
|
2025-03-26 02:48:34 +02:00 |
|
|
Karim shoair
|
9b0515b1cd
|
fix(defaults): Lazy Loading fetchers to lower memory usage on importing
|
2025-03-17 06:56:34 +02:00 |
|
|
Karim shoair
|
94f16ca1af
|
build: Pumping up the version
|
2025-03-17 06:47:43 +02:00 |
|
|
Karim shoair
|
ff3962b1ad
|
fix: Adjusting cache size in all the library
|
2025-03-17 06:46:41 +02:00 |
|
|
Karim shoair
|
bbc05ca164
|
fix(importing): Lazy Loading submodules to lower memory usage on importing
Load what you use instead of all submodules together
|
2025-03-17 06:24:42 +02:00 |
|
|
Karim shoair
|
68ac9d4d05
|
fix(parser): Lowering memory with replacing body property with html_content
|
2025-03-17 05:58:40 +02:00 |
|
|
Karim shoair
|
e5a022ec6a
|
fix(parser): Improving CSS selecting memory usage by ~144%
and speed by ~2%
|
2025-03-16 22:33:46 +02:00 |
|