cfc667f7dc
refactor(fetchers)!: Replace Camoufox with patchright and many optimizations
...
- DynamicFetcher became 20% faster
- StealthyFetcher became 99% faster
- Scrapling size decreased
- Code became ~400 lines shorter
- Most importantly, scrapling is more stable and reliable now.
- Less confusing for new users.
- More...
2025-12-26 03:21:13 +02:00
f9f34e6ee9
fix: improve the handling of useragent in chrome fetcher
2025-12-24 23:08:30 +02:00
b40c16a2cd
build: pump version up
2025-12-24 21:35:41 +02:00
85b327a598
fix: Improve stealth of dynamic browser by pinning Chrome's UA version
2025-12-24 21:34:44 +02:00
2e5152f790
v0.3.12
2025-12-18 02:21:43 +02:00
a7b55d4a74
test: fix for typo in the workflow
2025-12-18 01:48:47 +02:00
e53f1cb363
build: forcing playwright version
...
Until the Python driver for patchright 1.57 releases
2025-12-18 01:45:21 +02:00
580bc5390f
test: Adjusting test workflow for GitHub
2025-12-18 01:44:05 +02:00
1694b44a2b
test: adjusting deps versions for tox
2025-12-18 01:30:00 +02:00
381c4eab7f
test: skip checking camoufox browser version if he cache hits
...
To avoid GitHub repeated rate-limit errors
2025-12-18 01:23:50 +02:00
ecb97d3fd6
docs: add docs for timezone_id argument
2025-12-18 01:16:22 +02:00
9443ab80ae
test: update tests accordingly
2025-12-18 01:14:05 +02:00
39f544eae4
feat(dynamicSession): add the option to set timezone of the browser
2025-12-18 01:13:31 +02:00
b507e4d4a0
refactor(fetchers): rename internal api
...
To make it easier to use to use sessions outside `with` context
2025-12-17 01:27:40 +02:00
ae719a9d54
fix(parser): Improve response to json conversion
2025-12-17 00:15:55 +02:00
fd9fc83c6c
build: pump version up and deps
2025-12-17 00:04:24 +02:00
f6862f8170
docs: Add new sponsor
2025-12-09 12:47:36 +02:00
465b0f4733
docs: Add new sponsor
2025-12-08 03:35:24 +02:00
0f9127e975
v0.3.11
2025-12-03 03:52:52 +02:00
51d347270f
build: remove unnecessary reinstallation of deps in tox
2025-12-03 03:43:17 +02:00
aed34e43b5
fix(fetchers): better handling for infinite network_idle
2025-12-03 03:11:30 +02:00
16ff07a287
build: Pump version up and mcp
2025-12-03 02:20:18 +02:00
ac2d4d3833
fix: use the correct signature for the stealthy_fetch shortcut
2025-12-02 02:15:42 +02:00
ab0be95129
v0.3.10
2025-11-26 19:49:23 +02:00
eb15aae444
docs: update benchmarks with the current results
2025-11-26 02:50:01 +02:00
ab23b71836
tests(fetchers): Update tests to use the new argument naming
2025-11-26 02:23:54 +02:00
0e1f3b9b05
fix(fetchers): Add backward compatibility for custom_config argument
2025-11-26 02:23:17 +02:00
9b3309f825
fix(shell): use correct argument name in signatures
2025-11-26 02:22:29 +02:00
f84fbe8814
docs: update the renamed argument
2025-11-26 02:12:50 +02:00
880b144af0
refactor(browser fetchers): Make all the type hints dynamic + Faster validation
...
+ Also renamed `custom_config` to `selector_config` so it matches the session class.
2025-11-25 22:03:45 +02:00
8940bdeb55
fix(shell): dynamically build the signature of shortcuts after last changes
2025-11-25 21:23:06 +02:00
04a612e64e
docs: fix docstrings for all requests methods
2025-11-25 21:05:21 +02:00
57e11cef76
tests: Update tests accordingly
2025-11-25 20:25:23 +02:00
5376c97996
fix(fetcher): Remove non-keywords arguments
2025-11-25 20:25:09 +02:00
f0b01fc253
refactor(browser fetchers): Make all the type hints dynamic + Faster validation
...
Made the code shorter by an additional ~200 lines and easier to maintain in return for making the arguments autocompletion bad for shells that don't check for dynamic type hints like IPython.
2025-11-25 20:18:36 +02:00
9e85311ff6
fix(validators): Fix overriding session values with request ones
2025-11-25 19:48:09 +02:00
74f24d60f6
fix(fetcher): Replace vars logic with one that doesn't require dict attribute
2025-11-24 13:04:12 +02:00
abc9aaebfe
build: Pump deps up
...
msgspec now supports py14
2025-11-24 13:03:18 +02:00
088d1912d6
ops: fix tests workflow caching
2025-11-24 12:52:28 +02:00
abaf877eff
ops: fix tests workflow caching
2025-11-24 03:55:13 +02:00
b5cb235c53
ops: fix tests workflow caching
2025-11-24 03:30:14 +02:00
c487faf4fd
pref(requests): Optimizing memory by specifiying slots
2025-11-23 21:50:54 +02:00
357b170e1c
refactor(requests): Make all the type hints dynamic
...
Made the code shorter by about ~500 lines and easier to maintain in return for making the arguments autocompletion bad for shells that don't check for dynamic type hints like IPython.
2025-11-23 20:48:51 +02:00
2bae3261a0
build: Pumping version and deps up
...
This also updates the Maxmind database for camoufox
2025-11-22 21:41:47 +02:00
170205599d
fix(parser): Better approach for web pages where the encoding is not always correctly declared
...
Fixes #110 and avoids defaulting to a specific encoding like #111
2025-11-22 20:24:55 +02:00
48313307d0
docs: update ads order
2025-11-21 17:50:18 +02:00
2a9aef8d48
docs: Make Serpapi as Gold-tier sponsor
2025-11-21 17:30:55 +02:00
2506f21cf6
docs: fix releases link
2025-11-19 16:23:39 +02:00
e6e65ba360
v0.3.9
2025-11-17 03:38:46 +02:00
9602ad6986
docs: Add the remove_entities argument
2025-11-17 03:20:49 +02:00
Karim shoair