ae60c2c0ad
fix(playwright engine): bug in checking nstbrowser_config type
2025-01-30 20:07:19 +02:00
148103f3c8
fix(translator): increase CSS to XPath convertor cache limit
2025-01-30 20:01:25 +02:00
c0d912d16a
fix(asyncFetcher): A typo made async version of put do post request instead
...
Awkward moment
2025-01-30 19:53:13 +02:00
7882cf2527
style(TextHandler): Setting overload on check_match argument for auto completion
2025-01-30 02:44:57 +02:00
e507778c48
feat(Parser): Set regex methods new return types as TextHandlers
2025-01-30 02:27:38 +02:00
93be416572
feat(TextHandler): Now regex methods return TextHandler/TextHandlers
2025-01-30 02:15:09 +02:00
4e2e7a4b22
fix(parser): More on correcting type hints and unifying return type
2025-01-30 02:03:09 +02:00
7ee0f6114d
fix(parser): Code restructure for speed boost & better type hints
...
- Now return types are consistent across all the parser engine
- Parser got a 5-30% performance boost across different methods.
- Renamed some of the internal methods for clearer code.
- A lot better auto-completion experience after a lot of adjustments.
2025-01-30 01:46:33 +02:00
1d5fcc060d
feat(TextHandler): Make slicing return TextHandlers + autocompletion fixes
...
and access by index return `TextHandler`
2025-01-29 14:22:47 +02:00
70ffdd09e2
feat(TextHandler): Make split string method return Texthandlers
2025-01-29 01:22:07 +02:00
5047e886a5
style(autocompletion): Improving type hints for custom types
...
This will provide a better autocompletion experience inside IDEs, commit affects:
- TextHandler
- AttributesHandler
2025-01-29 00:58:14 +02:00
85f98708b2
feat(StealthyFetcher): Use memory cache by default for performance boost
...
This is instead of the default disk-based cache.
2025-01-28 23:55:24 +02:00
e9e606bca5
feat(StealthyFetcher): Disable Cross-Origin-Opener-Policy by default for async_fetch
...
This allows elements in cross-origin iframes, such as the Turnstile checkbox, to be clicked.
.
Forgot to add it with the other commit
2025-01-28 23:53:12 +02:00
675c0110e6
feat(StealthyFetcher): Make ads enabled by default for performance boost
2025-01-28 23:51:31 +02:00
52b66c98ec
feat(StealthyFetcher): Disable Cross-Origin-Opener-Policy by default
...
This allows elements in cross-origin iframes, such as the Turnstile checkbox, to be clicked.
2025-01-28 23:47:47 +02:00
1332be7e63
fix(autocompletion): Fix the defaults import
...
It runs autocompletion on some IDEs
2025-01-28 23:44:58 +02:00
c2447e069e
build: Pumping version up
2025-01-28 23:41:48 +02:00
99fe842bc9
build: updating dependencies
2025-01-28 23:40:56 +02:00
21291958f1
docs(README file): Better more-friendly description
2025-01-28 23:10:56 +02:00
198b76f5d5
Test: disable stealth parameter
...
It causes issues with Github Actions
2025-01-28 13:43:36 +02:00
7776e191e8
Update test_playwright.py
2025-01-28 13:42:11 +02:00
75a965e802
Update FUNDING.yml
2025-01-27 21:14:50 +02:00
0e1dcd4f29
Adding Scrapeless sponsor
2025-01-06 11:59:19 +02:00
32d96606ea
Merge pull request #27 from D4Vinci/dev
...
v0.2.92
2024-12-26 20:03:24 +02:00
c5d83a11ad
build: Pumping version up
2024-12-26 19:57:25 +02:00
ef284234e6
docs: update README file to reflect new installation instructions
2024-12-26 19:56:37 +02:00
03b52aa74c
feat(cli): adding terminal command scrapling install
...
Instead of making users install browsers by themself
2024-12-26 19:46:22 +02:00
2006be2173
fix(StealthyFetcher): Use more dependable response data
2024-12-26 00:29:42 +02:00
f9b85cfbac
fix(PlaywrightFetcher): Use more dependable response data
2024-12-26 00:27:13 +02:00
3cca3fd56b
style(parser): more accurate type hints
2024-12-21 16:17:02 +02:00
ee599141fe
Merge pull request #26 from D4Vinci/dev
...
v0.2.91
2024-12-19 13:51:53 +02:00
bb398693b8
feat(Fetcher): Adding support to proxies using the SOCKS protocol
2024-12-19 13:30:43 +02:00
f74db648bc
build: Pumping up the version to 0.2.91
2024-12-19 13:29:45 +02:00
5be8c2a95e
style(Fetchers): Setting correct type hint for wait_selector_state argument
2024-12-19 13:22:12 +02:00
94745b1555
fix(StealthyFetcher): Wait for the real response status code
...
This will return the real status response after redirection for websites that have Cloudflare instead of Playwright API's default behavior.
2024-12-19 13:08:41 +02:00
844cb0c6a2
fix(PlaywrightFetcher): Wait for the real response status code
...
This will return the real status response after redirection for websites that have Cloudflare instead of Playwright's default behavior.
2024-12-19 13:00:19 +02:00
6652b8ac18
fix: solve the response log issue so now you get log for every response from Fetchers
2024-12-19 12:29:34 +02:00
60df72cb23
Merge pull request #25 from D4Vinci/dev
...
v0.2.9
2024-12-16 14:42:13 +02:00
838b8b1196
style: fixing a typo in logging
2024-12-16 13:39:30 +02:00
c282cb3cb7
fix: Stopped the log spamming that happens with multiple instances creation
2024-12-16 13:35:48 +02:00
ac95600650
docs: add an example that uses page.urljoin
2024-12-16 13:27:14 +02:00
20ef45349a
test: Rewrite automatch tests to a cleaner version and adding async test
2024-12-16 13:18:19 +02:00
69e31612a5
test: Rewrite parser tests to a cleaner version and adding more tests
2024-12-16 13:17:09 +02:00
3ff0d55c3e
chore: Delete former-sponsor banner
2024-12-16 12:47:43 +02:00
43b41b3733
docs: fix TOC header
2024-12-16 12:41:07 +02:00
6cf5ce9719
docs: Adding async examples and fixing some typos
2024-12-16 12:39:44 +02:00
05c6eeb387
fix: add AsyncFetcher to top-level shortcuts
2024-12-16 12:37:29 +02:00
d66ebc19a5
fix(Fetchers/disable_resources): Fixing the logic for intercepting resources
2024-12-16 12:35:25 +02:00
eceef48ef5
fix(Fetchers/page_action): Fixing logic
2024-12-16 12:34:23 +02:00
3ecffcb81c
style: Rewrite sync Fetchers tests to a cleaner version
2024-12-16 01:27:18 +02:00
Karim shoair