9b0515b1cd
fix(defaults): Lazy Loading fetchers to lower memory usage on importing
2025-03-17 06:56:34 +02:00
94f16ca1af
build: Pumping up the version
2025-03-17 06:47:43 +02:00
ff3962b1ad
fix: Adjusting cache size in all the library
2025-03-17 06:46:41 +02:00
bbc05ca164
fix(importing): Lazy Loading submodules to lower memory usage on importing
...
Load what you use instead of all submodules together
2025-03-17 06:24:42 +02:00
68ac9d4d05
fix(parser): Lowering memory with replacing body property with html_content
2025-03-17 05:58:40 +02:00
e5a022ec6a
fix(parser): Improving CSS selecting memory usage by ~144%
...
and speed by ~2%
2025-03-16 22:33:46 +02:00
257b740e1d
build: Pumping up the version
2025-03-15 02:38:46 +02:00
7bef44ea4c
fix: Limit caching in all the library
...
To lower memory usage with high numbers of requests. Possibly improve case #48
2025-03-15 02:01:16 +02:00
4f75827641
refactor(fetchers): Clearer more accurate type hints
2025-03-15 01:47:41 +02:00
b5c7a8c36d
refactor/fix(Fetcher engine): Improvements and fixes
...
- Added the retries argument to the async methods, I don't understand how I missed it but that's why the code is rewritten now for easier maintenance.
2025-03-15 01:46:38 +02:00
0c31fb7c0e
refactor/fix(Playwright engine): Improvements and fixes
2025-03-15 01:45:12 +02:00
a2123fe91c
refactor/fix(Camo engine): Improvements and fixes
2025-03-15 01:44:49 +02:00
94909099a9
fix(Parser): Change default text content to empty string instead of None
...
For compatibility with previous fix/commit
2025-03-15 00:56:19 +02:00
bf6a3a9c20
fix(TextHandler): auto handling non-string type variables
...
Fix for #45
2025-03-08 01:42:58 +02:00
f8662bee29
feat(cli): Adding the -f flag to install command
2025-03-05 03:32:43 +02:00
087a85d615
fix(cli): Fix issue where install drops user into Python Shell
2025-03-05 03:28:07 +02:00
5f06a34a2f
build: Pumping version up
2025-03-05 03:13:47 +02:00
e9344a7384
fix(TextHandler): Fixing an issue with slicing
...
Slicing was returning `TextHandlers` instead of `TextHandler`. This solves #41 and corrects the type hint
2025-03-05 03:11:46 +02:00
dc702d2d7c
build: pumping version up
2025-02-25 23:57:31 +02:00
5f4ec3ba3a
fix(Fetcher): make stealthy_headers don't overwrite user headers
...
Fix for #39
2025-02-25 23:14:59 +02:00
aa4d365901
fix(StealthyFetcher): no need to disable coop now
...
Camoufox can now click inside coop iframes without it
2025-02-22 18:46:02 +02:00
10ecd41444
feat(StealthyFetcher): Add the redirections history
2025-02-22 18:45:17 +02:00
8049ac0f28
feat(PlayWrightFetcher): Add the redirections history
2025-02-22 17:47:27 +02:00
3d2418b67a
feat(Fetcher): Add the redirections history to Fetcher
...
Feature requested in #32
2025-02-22 16:58:54 +02:00
f0db07a31f
build: pumping up deps and version to 0.2.94
2025-02-22 15:25:35 +02:00
390bd51cb1
fix(TextHandler): correcting case_sensitive argument logic
...
This is awkward, I can't believe how this slipped from me!
2025-02-22 15:20:11 +02:00
7c35341d85
refactor(parser/get_all_text): Cleaner and a bit faster implementation
2025-01-31 02:47:49 +02:00
a6fd25f64c
fix(parser): fix traverse selectors
2025-01-31 01:57:19 +02:00
a8d475afb0
feat(parser): Make all returned html as TextHandler
...
So you can do regex on raw html if wanted etc...
2025-01-31 01:38:48 +02:00
3330e9f475
refactor(parser/automatch): Cleaner and faster implementation
...
~5% speed boost
2025-01-31 01:34:02 +02:00
37a31a120e
refactor(parser/find_by_regex): Better implementation for ~60% speed boost
2025-01-31 01:19:11 +02:00
2c6142d96d
refactor(parser/find_by_text): Better implementation for ~20% speed boost
2025-01-31 01:12:00 +02:00
3f23f18473
style(TextHandler): fix re overload
2025-01-31 00:48:27 +02:00
1962c11f64
fix(parser/find_all): Logic issues made conditions used sometimes in a (and) fashion and other times (OR)
...
Also, the speed boost is 6-14% not 95% as I said first :(
2025-01-31 00:23:54 +02:00
57090f90a4
refactor(parser/find_all): about ~95% speed increase
...
Boom!
2025-01-30 23:39:46 +02:00
f37538320f
feat(parser): adding below_elements method
2025-01-30 23:05:10 +02:00
ae60c2c0ad
fix(playwright engine): bug in checking nstbrowser_config type
2025-01-30 20:07:19 +02:00
148103f3c8
fix(translator): increase CSS to XPath convertor cache limit
2025-01-30 20:01:25 +02:00
c0d912d16a
fix(asyncFetcher): A typo made async version of put do post request instead
...
Awkward moment
2025-01-30 19:53:13 +02:00
7882cf2527
style(TextHandler): Setting overload on check_match argument for auto completion
2025-01-30 02:44:57 +02:00
e507778c48
feat(Parser): Set regex methods new return types as TextHandlers
2025-01-30 02:27:38 +02:00
93be416572
feat(TextHandler): Now regex methods return TextHandler/TextHandlers
2025-01-30 02:15:09 +02:00
4e2e7a4b22
fix(parser): More on correcting type hints and unifying return type
2025-01-30 02:03:09 +02:00
7ee0f6114d
fix(parser): Code restructure for speed boost & better type hints
...
- Now return types are consistent across all the parser engine
- Parser got a 5-30% performance boost across different methods.
- Renamed some of the internal methods for clearer code.
- A lot better auto-completion experience after a lot of adjustments.
2025-01-30 01:46:33 +02:00
1d5fcc060d
feat(TextHandler): Make slicing return TextHandlers + autocompletion fixes
...
and access by index return `TextHandler`
2025-01-29 14:22:47 +02:00
70ffdd09e2
feat(TextHandler): Make split string method return Texthandlers
2025-01-29 01:22:07 +02:00
5047e886a5
style(autocompletion): Improving type hints for custom types
...
This will provide a better autocompletion experience inside IDEs, commit affects:
- TextHandler
- AttributesHandler
2025-01-29 00:58:14 +02:00
85f98708b2
feat(StealthyFetcher): Use memory cache by default for performance boost
...
This is instead of the default disk-based cache.
2025-01-28 23:55:24 +02:00
e9e606bca5
feat(StealthyFetcher): Disable Cross-Origin-Opener-Policy by default for async_fetch
...
This allows elements in cross-origin iframes, such as the Turnstile checkbox, to be clicked.
.
Forgot to add it with the other commit
2025-01-28 23:53:12 +02:00
675c0110e6
feat(StealthyFetcher): Make ads enabled by default for performance boost
2025-01-28 23:51:31 +02:00
Karim shoair