Karim shoair
d02da49865
docs: fix downloads badge
2025-10-29 14:43:43 +03:00
Karim shoair
6cc48161cd
docs: Update docker instructions
2025-10-28 17:20:27 +03:00
Karim shoair
58784b7c90
v0.3.8
2025-10-27 18:08:18 +03:00
Karim shoair
1e4d1e73a0
ops: Make container image pushed to Github registry too
2025-10-27 17:36:44 +03:00
Karim shoair
3c8d5c68e8
docs: updating external links
2025-10-27 16:42:03 +03:00
Karim shoair
33ed7fcf7d
Merge branch 'main' into dev
2025-10-27 16:38:48 +03:00
Karim shoair
ba7015bc57
docs: Add new sponsor
2025-10-27 16:38:13 +03:00
Karim shoair
37cb5097c0
docs: update external browser tutorial
2025-10-27 06:33:45 +03:00
Karim shoair
339ec43341
docs: adding separate doc for external browser
2025-10-27 06:32:31 +03:00
Karim shoair
fc4a809985
fix(cloudflare): Limit the waiting period for websites that captcha doesn't disappear after solving
...
Also solves #100
2025-10-27 05:13:12 +03:00
Karim shoair
d4a2507666
refactor(validation): All browser based fetchers are ~8-15% faster now in most cases
2025-10-27 04:48:45 +03:00
Karim shoair
13b9a4668c
feat(DynamicSession): New option to add extra browser flags
2025-10-26 16:53:27 +03:00
Karim shoair
f9a514cc64
build: Pump up deps
2025-10-26 05:04:53 +03:00
Karim shoair
59ec6be201
refactor(fetchers): Less duplicated code and better handling for unstable websites
...
- Websites that never finish loading their requests won't crash the code now if you used `network_idle` with them
- Fixed a typo in `load_dom` in DynamicSession's async_fetch
- Removed dead code
2025-10-26 05:04:19 +03:00
Karim shoair
74fa45daea
fix: Addressing the issue of collecting response after page_action in #100
2025-10-26 00:41:45 +03:00
Karim shoair
43db79d1df
docs: adding cloud browser segment
2025-10-25 22:29:07 +03:00
Karim shoair
cabf5f963d
Merge branch 'main' into dev
2025-10-22 15:39:07 +03:00
Karim shoair
c796787863
docs: Update sponsor banner
2025-10-22 15:23:39 +03:00
Karim shoair
a54ceb3335
build: Pumping up the deps and the version
2025-10-19 15:38:46 +03:00
Karim shoair
e1bbeffd9f
docs: update sponsor tiers perks
2025-10-18 18:02:40 +03:00
Karim shoair
5c0a509b0f
docs: Remove a sponsor
2025-10-18 17:59:08 +03:00
Karim shoair
778d0d13a7
docs: Adding a new sponsor
2025-10-15 15:15:48 +03:00
Karim shoair
5bd5dc5f51
v0.3.7 ( #99 )
2025-10-12 07:35:48 +03:00
Karim shoair
f9eff25e24
docs: update website accordingly
2025-10-12 06:59:20 +03:00
Karim shoair
9c7114219b
fix(solver): Improve the logic a bit
2025-10-12 06:41:04 +03:00
Karim shoair
a38b92cc87
feat(Dynamic fetcher): Add additional_args option to customize browser as in StealthyFetcher
2025-10-12 05:07:22 +03:00
Karim shoair
4fea8c2e59
docs: Update docs accordingly
2025-10-12 04:51:11 +03:00
Karim shoair
c34e10faed
feat(fetchers): Add argument to control the user data directory
2025-10-12 04:48:59 +03:00
Karim shoair
8c995c936d
fix(CF solver): further improve the detection
2025-10-12 04:15:16 +03:00
Karim shoair
073c4910d4
fix(fetchers): More accurate collection of the final response
...
This will make the `response.body` return the raw response for text/json responses as well
2025-10-12 04:12:18 +03:00
Karim shoair
6bfa266c90
fix(camoufox): Fix a typo in the async solver
2025-10-12 03:07:18 +03:00
Karim shoair
1ff09e5b47
Merge branch 'main' into dev
2025-10-06 17:19:14 +03:00
Karim shoair
458ad5b36a
docs: remove a sponsor
2025-10-06 17:18:49 +03:00
Karim shoair
0dffa3bbba
docs: removing unnecessary docstrings
...
They are internal functions, not user-facing ones
2025-10-06 14:24:16 +03:00
Karim shoair
f9303ab275
test: update session tests
2025-10-06 06:53:24 +03:00
Karim shoair
9cae97b177
fix(requests): Fix multiple configuration issues
2025-10-06 06:53:09 +03:00
Karim shoair
390916ba45
tests: change test accordingly
2025-10-06 05:00:58 +03:00
Karim shoair
e53ce3f749
refactor: Making the requests logic better and cleaner
...
Also, solve some bugs along the way and a cleaner fix for #97
2025-10-06 05:00:41 +03:00
Karim shoair
cc45ded0cf
ops: update pre-commit hooks
2025-10-05 04:12:18 +03:00
Karim shoair
c01fefadea
ops: change docker workflow trigger
2025-10-05 04:11:14 +03:00
Karim shoair
f4ce433ff3
build: pump up the version and deps
2025-10-05 04:08:19 +03:00
Karim shoair
b80f866434
docs: update an outdated part
2025-10-05 04:04:09 +03:00
Karim shoair
debe03256b
refactor: Making all the codebase acceptable by PyRight
...
Also fixes #97
2025-10-05 04:03:39 +03:00
Karim shoair
e149c715dd
feat(CF solver): better implementation to help with all custom implementations of turnstile
2025-10-02 20:05:39 +03:00
Karim shoair
db1179790e
docs: correcting docker installation instruction
2025-10-01 07:30:49 +03:00
Karim shoair
653fbb0594
ops: fix docker image name
2025-10-01 07:19:48 +03:00
Karim shoair
e8b0e72512
v0.3.6 ( #95 )
2025-10-01 06:40:04 +03:00
Karim shoair
a7e29a1662
docs: Update introduction
2025-10-01 06:26:19 +03:00
Karim shoair
5127d386c9
style(Fetcher): correcting type hints and annotation
2025-10-01 06:18:23 +03:00
Karim shoair
849913ad77
style: Correcting return type annotation for Fetcher/AsyncFetcher ( #93 )
2025-10-01 04:17:59 +03:00
Karim shoair
7aa083053b
test: change tests accordingly
2025-10-01 03:50:57 +03:00
Karim shoair
eedfa855ab
fix: Fixes for the type checking in the main init file
...
and a bit of cleaning
2025-10-01 03:50:39 +03:00
Karim shoair
4135dd86b8
refactor: Restructure the fetchers code to not use more memory than needed
...
Also fixes : #92
2025-10-01 03:48:43 +03:00
Karim shoair
ec3809ce40
docs: fix installation section on the website
2025-09-29 17:50:45 +03:00
Karim shoair
f6c122b87f
style: Removing dead code/docstrings
2025-09-29 05:09:23 +03:00
Karim shoair
8ad7cd6343
docs: Update all pages/docstrings to reflect recent changes
2025-09-29 03:57:40 +03:00
Karim shoair
0cf3bcf3aa
ops: improve the layering of the docker image
2025-09-29 02:53:06 +03:00
Karim shoair
840aef6884
build: Pump up version and deps
2025-09-28 22:04:09 +03:00
Karim shoair
2bad72b77a
fix: correct http option type in the mcp server
2025-09-28 21:19:51 +03:00
Karim shoair
6f0ce428aa
tests: update tests for mcp
2025-09-28 20:14:17 +03:00
Karim shoair
74f20d2a0e
refactor: better implementation for the mcp mode
2025-09-28 20:14:04 +03:00
Karim shoair
0b729176bc
ops: add workflow to build and push docker images
2025-09-28 04:56:01 +03:00
Karim shoair
8a867fc68e
feat: Add docker support
2025-09-28 04:55:00 +03:00
Karim shoair
4a661b4875
feat: Make mcp able to use http transport
2025-09-28 04:54:35 +03:00
Karim shoair
292208e22d
build: update bandit rules
2025-09-28 04:54:27 +03:00
Karim shoair
716a5c3572
feat(cf solver): Make solver able to handle Turnstile and interstitial
2025-09-28 02:53:51 +03:00
Karim shoair
3da806210b
perf: General code restructure to not use more than needed memory
2025-09-23 18:34:54 +03:00
Karim shoair
63a46a8e0b
fix(parser): An encoding issue with converting bytes to string on some encoding types
...
Removing that `invalid start byte` annoying bug
2025-09-23 18:32:56 +03:00
Karim shoair
38e7941b71
docs: add a new sponsor
2025-09-22 16:03:13 +03:00
Karim shoair
61078ca1d2
v0.3.5 ( #89 )
2025-09-20 15:57:08 +03:00
Karim shoair
82b09620b2
perf: Improving all browser-based fetches by ~15%
2025-09-20 06:20:23 +03:00
Karim shoair
970ad40404
perf: Speed up sync fetches by ignoring number of pages checking
2025-09-20 04:31:57 +03:00
Karim shoair
5164b801ec
build: pump version up and update deps
2025-09-20 00:33:07 +03:00
Karim shoair
67aa1a2ae7
tests: Add a test for using stealth and real_chrome arguments together
2025-09-20 00:23:55 +03:00
Karim shoair
67db865aee
feat(DynamicFetcher): Replace rebrowser with patchright
2025-09-20 00:23:29 +03:00
Karim shoair
386da62ec9
tests: fix CLI tests according to last changes
2025-09-19 23:17:54 +03:00
Karim shoair
0ee3f93227
Merge branch 'main' into dev
2025-09-19 07:01:53 +03:00
Karim shoair
165dc524f8
docs: add a new sponsor
2025-09-19 06:06:30 +03:00
Karim shoair
2d704b2a8b
fix(shell): Fixing a bug with content converting
2025-09-19 04:50:15 +03:00
Karim shoair
a9d05cc0ef
style: Removing dead code/docstrings and correcting type hints
2025-09-19 04:49:30 +03:00
Karim shoair
bf5fe6d451
fix(shell): Fix view command edge case
2025-09-19 04:21:15 +03:00
Karim shoair
504ecdf7dc
fix(shell): Fix parsing curl --data-raw
2025-09-19 04:20:16 +03:00
Karim shoair
b197f8a5f9
fix(parser): Improve selectors re function
2025-09-18 13:56:37 +03:00
Karim shoair
41c8a2dcca
Merge branch 'main' into dev
2025-09-18 13:55:48 +03:00
Karim shoair
189f323904
misc: update sponsor poster
2025-09-18 13:31:17 +03:00
Karim shoair
ddf5b52e3b
Improve page management and speed up execution ( #87 )
2025-09-18 03:34:40 +03:00
Karim shoair
6b2675c7dd
v0.3.4 ( #86 )
2025-09-16 15:50:22 +03:00
Karim shoair
1550ba64bb
docs: Adding new sponsor
2025-09-16 15:35:22 +03:00
Karim shoair
570303f938
fix(parser): Make html_content and prettify return strings not bytes (depends on the encoding)
2025-09-16 01:58:51 +03:00
Karim shoair
5683965367
fix(sessions): Fixing a bug with max pages counter
2025-09-16 01:47:31 +03:00
Karim shoair
b7327466cf
build: pump version up
2025-09-15 23:35:08 +03:00
Karim shoair
05c2d9aa00
feat(CLI): Make the session classes available in the shell
2025-09-15 23:34:36 +03:00
Karim shoair
5bcd4c2927
fix: A workaround for Playwright issue with page content retrieving on windows
2025-09-15 21:34:20 +03:00
Karim shoair
bdcf96fa9e
Merge branch 'main' into dev
2025-09-15 21:33:49 +03:00
Karim shoair
1547366c85
fix: fixing body issue with cli view command
2025-09-15 21:32:57 +03:00
Karim shoair
8a54745e47
v0.3.3 ( #84 )
2025-09-15 14:06:24 +03:00
Karim shoair
f3a1f1ecb4
Merge branch 'main' into dev
2025-09-15 13:52:40 +03:00
Karim shoair
a6aabda67c
build: Pump version up
2025-09-15 13:52:09 +03:00
Karim shoair
7a7097b775
fix: Stop removing browser default page
...
Looks like it's problematic with some systems so it doesn't worth the trouble
2025-09-15 13:43:47 +03:00
Karim shoair
fac92ef260
v0.3.2 ( #83 )
2025-09-15 04:28:55 +03:00
Karim shoair