d6844232eb
tests: Update all tests according to new update
2025-09-13 16:07:54 +03:00
13d7e70cb7
refactor: Make all fetchers as an optional dependency group
...
+ Removing some dead code
2025-09-13 16:07:48 +03:00
d7e3deae2a
fix: fix invalid dep version
2025-09-13 05:10:56 +03:00
521366e77e
build: bump up deps
2025-09-13 04:29:09 +03:00
80077953f6
docs: update all pages related to last changes
2025-09-13 04:19:16 +03:00
8c4d6158d6
feat(browser fetchers): A new option to control page JS
2025-09-13 03:59:12 +03:00
aaec00563c
ops: update pre-commit hooks
2025-09-13 03:34:28 +03:00
330d03559c
style: applying the new ruff rules to all files
2025-09-13 03:22:53 +03:00
60be9dc816
feat: Validate all fetch-level parameters
...
So it's validated like the session-level ones. Needs improvement, but that's for later
2025-09-13 03:22:08 +03:00
831eafca34
ops: Update ruff pre-commit rules
2025-09-13 03:07:15 +03:00
0c7db3c9d9
fix: validation keywords
2025-09-13 02:07:04 +03:00
adb82008e5
style: Using keywords for validation
...
Less lines of code and more stylish
2025-09-12 04:33:00 +03:00
e4b1e00e63
build: Pump up the version
2025-09-11 04:14:32 +03:00
05a714980d
docs: Update all docstring according to the new changes
2025-09-11 04:13:36 +03:00
9838d741d0
refactor/feat(browser fetchers): make it possible to have a configuration per page in sessions
...
- Also, no need for the `page_action` argument function to return the page again
2025-09-11 03:48:55 +03:00
931993f901
tests: changing tests accordingly
2025-09-08 16:09:24 +03:00
ecaec65049
refactor/fix(browser fetchers): Solving a logic bug in page rotation
...
- Pages that get reused in rotation are possibly contaminated from previous settings used on them, and some are stubborn to remove, so the new approach replaces finished pages with new ones.
- Removed the `max_pages` from sync `StealthySession` to match `DynamicSession` (Doesn't mean anything in sync code)
2025-09-08 16:08:57 +03:00
f298b76b8e
perf(StealthySession): Close persistent context default page
2025-09-07 18:48:51 +03:00
710f994339
perf(DynamicSession): Close persistent context default page
2025-09-07 18:48:40 +03:00
05761d4070
docs: Add YT video to the mcp page
2025-09-07 05:06:35 +03:00
4341477a66
perf(StealthyFetcher): Slight optimization
2025-09-07 04:58:55 +03:00
9e5ff5bb1b
chore: Add issue template for other issues
2025-09-07 04:36:00 +03:00
72e26c23e8
fix(DynamicFetcher): Improve stealth mode
2025-09-07 03:13:51 +03:00
31c14b3997
[ImgBot] Optimize images ( #79 )
2025-09-05 13:51:45 +03:00
fa76d64d61
docs: add new sponsor to the README
2025-09-05 13:46:17 +03:00
d46d0fdf39
[ImgBot] Optimize images
...
*Total -- 555.83kb -> 366.23kb (34.11%)
/docs/assets/scrapling_shell_curl.png -- 527.22kb -> 342.98kb (34.95%)
/images/NSTproxy.png -- 28.61kb -> 23.25kb (18.74%)
Signed-off-by: ImgBotApp <ImgBotHelp@gmail.com >
2025-09-05 10:45:19 +00:00
6f232b3874
misc: add new sponsor logo
2025-09-05 13:44:37 +03:00
23997f2755
v0.3.1 ( #78 )
2025-09-02 17:20:53 +03:00
934d8a1452
build: Pump up the version
2025-09-02 16:33:52 +03:00
e06f8d36db
docs: add init_script new argument
2025-09-02 16:32:19 +03:00
6ad1bab2e4
feat(DynamicFetcher): add the ability to add init_script to context ( #56 )
2025-09-02 16:25:13 +03:00
9543f171aa
feat(StealthyFetcher): add the ability to add init_script to context
2025-09-02 16:19:22 +03:00
d49e047736
tests: change tests accordingly
2025-09-02 15:23:30 +03:00
af9a62a539
fix: fix for shell imported by mistake issue ( #76 )
2025-09-02 15:23:15 +03:00
e7482a267a
docs: add interactive shell video to README.md
2025-09-01 22:11:40 +03:00
9021c4f9b7
docs: Changing sponsors order
2025-09-01 16:03:47 +03:00
d5aaeb9816
v0.3
2025-09-01 07:26:15 +03:00
812cf2d21b
build: Pump up the version
2025-09-01 06:43:41 +03:00
9e9e79d9b0
docs: fixes and adjustments
2025-09-01 06:39:17 +03:00
35b88fbb62
docs: add an api reference to the mcp server
2025-09-01 01:02:08 +03:00
7befcd54bc
chore: update the setup file description
2025-08-31 23:50:33 +03:00
e7858d7307
docs: updating the mkdocs file accordingly
2025-08-31 23:41:53 +03:00
e0c005b2cc
docs: add a page to the mcp server
2025-08-31 23:40:50 +03:00
734e5f73db
docs: Changing fonts and fixing some mistakes
2025-08-31 18:52:15 +03:00
878be9ccbf
tests: update tests accordingly
2025-08-31 02:57:30 +03:00
967c0956a1
feat(DynamicSession): Improve stealth mode
2025-08-31 02:57:12 +03:00
6eb580a6d0
feat(DynamicSession): Improve normal fetches speed
2025-08-31 02:56:34 +03:00
b5be2547d7
fix(dynamicSession): issue with headless
2025-08-31 01:29:47 +03:00
7153fdbcce
Merge branch 'dev' of https://github.com/D4Vinci/Scrapling into dev
2025-08-30 22:42:09 +03:00
beebddd6fe
docs: add cli overview page
2025-08-30 22:42:05 +03:00
Karim shoair