Commit Graph

938 Commits

Author SHA1 Message Date
Karim shoair 8ca0646172 docs: make the cli section clearer for README files of all languages 2025-12-27 16:55:27 +02:00
Karim shoair 423de087d4 docs: update README for all languages with the new updates 2025-12-27 16:40:47 +02:00
Karim shoair ab76f1bee7 docs: update the website main page 2025-12-27 16:26:30 +02:00
Karim shoair 423755fe82 fix: remove firefox from test workflow 2025-12-27 14:33:24 +02:00
Karim shoair 842718ba94 fix: update shell signatures for the autocompletion
Added missing fields and reordered classes as well for easier comparisons
2025-12-27 14:30:48 +02:00
Karim shoair 2af21e240d test: remove problematic sync tests
The async version are the same tests
2025-12-27 14:02:02 +02:00
Karim shoair 4753743f49 fix: pinning the deps version for tox 2025-12-26 14:44:26 +02:00
Karim shoair 5638755558 ops: update tests workflow accordingly 2025-12-26 03:23:28 +02:00
Karim shoair fdfd5bf96b test: update all tests accordingly 2025-12-26 03:22:56 +02:00
Karim shoair 67c8cb7de3 ops: update tox file accordingly 2025-12-26 03:22:28 +02:00
Karim shoair c5f32e495c ops: update docker file accordingly 2025-12-26 03:22:11 +02:00
Karim shoair ccf97803d5 build: update deps 2025-12-26 03:21:40 +02:00
Karim shoair cfc667f7dc refactor(fetchers)!: Replace Camoufox with patchright and many optimizations
- DynamicFetcher became 20% faster
- StealthyFetcher became 99% faster
- Scrapling size decreased
- Code became ~400 lines shorter
- Most importantly, scrapling is more stable and reliable now.
- Less confusing for new users.
- More...
2025-12-26 03:21:13 +02:00
Karim shoair f9f34e6ee9 fix: improve the handling of useragent in chrome fetcher 2025-12-24 23:08:30 +02:00
Karim shoair b40c16a2cd build: pump version up 2025-12-24 21:35:41 +02:00
Karim shoair 85b327a598 fix: Improve stealth of dynamic browser by pinning Chrome's UA version 2025-12-24 21:34:44 +02:00
Karim shoair 2e5152f790 v0.3.12 2025-12-18 02:21:43 +02:00
Karim shoair a7b55d4a74 test: fix for typo in the workflow 2025-12-18 01:48:47 +02:00
Karim shoair e53f1cb363 build: forcing playwright version
Until the Python driver for patchright 1.57 releases
2025-12-18 01:45:21 +02:00
Karim shoair 580bc5390f test: Adjusting test workflow for GitHub 2025-12-18 01:44:05 +02:00
Karim shoair 1694b44a2b test: adjusting deps versions for tox 2025-12-18 01:30:00 +02:00
Karim shoair 381c4eab7f test: skip checking camoufox browser version if he cache hits
To avoid GitHub repeated rate-limit errors
2025-12-18 01:23:50 +02:00
Karim shoair ecb97d3fd6 docs: add docs for timezone_id argument 2025-12-18 01:16:22 +02:00
Karim shoair 9443ab80ae test: update tests accordingly 2025-12-18 01:14:05 +02:00
Karim shoair 39f544eae4 feat(dynamicSession): add the option to set timezone of the browser 2025-12-18 01:13:31 +02:00
Karim shoair b507e4d4a0 refactor(fetchers): rename internal api
To make it easier to use to use sessions outside `with` context
2025-12-17 01:27:40 +02:00
Karim shoair ae719a9d54 fix(parser): Improve response to json conversion 2025-12-17 00:15:55 +02:00
Karim shoair fd9fc83c6c build: pump version up and deps 2025-12-17 00:04:24 +02:00
Karim shoair f6862f8170 docs: Add new sponsor 2025-12-09 12:47:36 +02:00
Karim shoair 465b0f4733 docs: Add new sponsor 2025-12-08 03:35:24 +02:00
Karim shoair 0f9127e975 v0.3.11 2025-12-03 03:52:52 +02:00
Karim shoair 51d347270f build: remove unnecessary reinstallation of deps in tox 2025-12-03 03:43:17 +02:00
Karim shoair aed34e43b5 fix(fetchers): better handling for infinite network_idle 2025-12-03 03:11:30 +02:00
Karim shoair 16ff07a287 build: Pump version up and mcp 2025-12-03 02:20:18 +02:00
Karim shoair ac2d4d3833 fix: use the correct signature for the stealthy_fetch shortcut 2025-12-02 02:15:42 +02:00
Karim shoair ab0be95129 v0.3.10 2025-11-26 19:49:23 +02:00
Karim shoair eb15aae444 docs: update benchmarks with the current results 2025-11-26 02:50:01 +02:00
Karim shoair ab23b71836 tests(fetchers): Update tests to use the new argument naming 2025-11-26 02:23:54 +02:00
Karim shoair 0e1f3b9b05 fix(fetchers): Add backward compatibility for custom_config argument 2025-11-26 02:23:17 +02:00
Karim shoair 9b3309f825 fix(shell): use correct argument name in signatures 2025-11-26 02:22:29 +02:00
Karim shoair f84fbe8814 docs: update the renamed argument 2025-11-26 02:12:50 +02:00
Karim shoair 880b144af0 refactor(browser fetchers): Make all the type hints dynamic + Faster validation
+ Also renamed `custom_config` to `selector_config` so it matches the session class.
2025-11-25 22:03:45 +02:00
Karim shoair 8940bdeb55 fix(shell): dynamically build the signature of shortcuts after last changes 2025-11-25 21:23:06 +02:00
Karim shoair 04a612e64e docs: fix docstrings for all requests methods 2025-11-25 21:05:21 +02:00
Karim shoair 57e11cef76 tests: Update tests accordingly 2025-11-25 20:25:23 +02:00
Karim shoair 5376c97996 fix(fetcher): Remove non-keywords arguments 2025-11-25 20:25:09 +02:00
Karim shoair f0b01fc253 refactor(browser fetchers): Make all the type hints dynamic + Faster validation
Made the code shorter by an additional ~200 lines and easier to maintain in return for making the arguments autocompletion bad for shells that don't check for dynamic type hints like IPython.
2025-11-25 20:18:36 +02:00
Karim shoair 9e85311ff6 fix(validators): Fix overriding session values with request ones 2025-11-25 19:48:09 +02:00
Karim shoair 74f24d60f6 fix(fetcher): Replace vars logic with one that doesn't require dict attribute 2025-11-24 13:04:12 +02:00
Karim shoair abc9aaebfe build: Pump deps up
msgspec now supports py14
2025-11-24 13:03:18 +02:00