Karim shoair
53dd360296
docs: add mcp integrated badge
2026-02-26 23:56:42 +02:00
Karim shoair
2904441b42
fix: make MCP get schemas validator-safe ( #137 )
2026-02-26 23:54:48 +02:00
Karim shoair
6c12c196ac
Merge branch 'dev' into fix/mcp-schema-auth-cookies
2026-02-26 23:54:18 +02:00
Karim shoair
bcc93f392d
Merge branch 'main' into dev
2026-02-26 18:57:27 +02:00
Karim shoair
b54a49b717
ops: Upgrade GitHub Actions to latest versions ( #144 )
2026-02-26 18:56:54 +02:00
Karim shoair
46fd1506dc
Merge branch 'main' into upgrade-github-actions-node24-general
2026-02-26 18:56:36 +02:00
Karim shoair
908ede1c64
ops: Upgrade GitHub Actions for Node 24 compatibility ( #143 )
2026-02-26 18:56:20 +02:00
Karim shoair
ccce0fc552
Merge branch 'main' into upgrade-github-actions-node24
2026-02-26 18:55:45 +02:00
Karim shoair
9708354c80
Fix: Improve regex precision for Cloudflare challenge detection ( #133 )
2026-02-26 18:53:13 +02:00
Karim shoair
50e0be5c1c
Merge branch 'dev' into fix/cloudflare-regex
2026-02-26 18:52:37 +02:00
Karim shoair
558e9a6fa0
Merge branch 'main' into dev
2026-02-25 23:55:53 +02:00
Karim shoair
7ebe3a01a3
docs: removing an irrelevant article
2026-02-25 23:54:24 +02:00
Salman Muin Kayser Chishti
8de47c9bd7
Upgrade GitHub Actions to latest versions
...
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com >
2026-02-25 09:21:41 +00:00
Salman Muin Kayser Chishti
0aabceb74e
Upgrade GitHub Actions for Node 24 compatibility
...
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com >
2026-02-25 09:21:38 +00:00
Karim shoair
6943ec27f8
docs: typo correction
2026-02-25 02:23:36 +02:00
Karim shoair
e7b0fe7b46
Merge branch 'main' into dev
2026-02-25 02:23:08 +02:00
Karim shoair
5b948d34df
docs: add the trending badge
2026-02-25 02:06:09 +02:00
Karim shoair
d934fe876c
Merge branch 'main' into dev
2026-02-25 01:59:14 +02:00
Karim shoair
8c9402f9f0
docs: adding new sponsor
2026-02-24 15:28:37 +02:00
Karim shoair
c0aec234eb
docs: update sponsorship plans and corrections
2026-02-24 15:19:23 +02:00
Robin Ede
b77a1b9419
fix: make MCP get schemas validator-safe
...
Use JSON-object input types for cookies and basic-auth fields in get and bulk_get so strict MCP schema validators can register tools reliably.
Normalize auth dictionaries to the tuple format expected by fetchers to preserve runtime behavior.
2026-02-23 19:49:39 -06:00
Karim shoair
b503f537ce
docs: corrections to the sponsorship page
2026-02-23 03:49:16 +02:00
Karim shoair
a0cc3857d0
docs: corrections to the sponsorship page
2026-02-23 03:27:43 +02:00
Karim shoair
aed842c42e
docs: update sponsorship plans
2026-02-23 03:25:18 +02:00
Karim shoair
f537613921
docs: shortening the demo code in the README
2026-02-23 03:04:27 +02:00
Karim shoair
a6beaaba89
docs: adjustments to sponsors placement
2026-02-23 02:58:25 +02:00
Karim shoair
4072c5e83d
docs: update readme URLs
2026-02-23 02:45:37 +02:00
Karim shoair
1f5a7d5d2c
ops: add mcp registry file
2026-02-23 02:31:28 +02:00
RinZ27
aa90dda439
fix: improve regex precision for Cloudflare challenge detection
2026-02-18 14:02:31 +07:00
Karim shoair
2b56a87e36
Merge branch 'main' into dev
2026-02-18 04:47:32 +02:00
Karim shoair
cd13a695cb
docs: adjustments to website metadata
2026-02-18 04:33:39 +02:00
Karim shoair
a9b785aa8f
docs: add media preview image
2026-02-18 04:26:09 +02:00
Karim shoair
60eea3ba68
docs: add media preview image
2026-02-18 00:04:53 +02:00
Karim shoair
f21e7462e4
docs: fix cookie consent
2026-02-15 15:11:48 +02:00
Karim shoair
1bbb18ad8e
build: fix readme path for pypi
2026-02-15 07:16:28 +02:00
Karim shoair
04d796b821
v0.4
2026-02-15 07:13:28 +02:00
Karim shoair
95ad2842e9
docs: add an entry for the 0.4 version
2026-02-15 04:40:43 +02:00
Karim shoair
b19fa5e694
fix(checkpoint): correct error message
2026-02-15 04:36:43 +02:00
Karim shoair
e35ba3455c
test: add tests for spiders engine
...
Automated tests written by AI
2026-02-15 04:35:28 +02:00
Karim shoair
02b11c535e
fix(spiders): corrections and removal of dead code
2026-02-15 04:25:32 +02:00
Karim shoair
b8b9a7f864
docs: general correction across all the pages
...
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00
Karim shoair
93bcb1681b
style: docstrings corrections for accuracy
2026-02-15 03:57:14 +02:00
Karim shoair
1bf6bb8d65
docs: update the images urls to use main branch
2026-02-15 03:29:57 +02:00
Karim shoair
7b8fc911e1
docs: add a page for spiders advanced usage
2026-02-15 02:40:55 +02:00
Karim shoair
7b4523af8e
docs: update the titles for all files
2026-02-15 02:35:39 +02:00
Karim shoair
c3374bce41
docs: add a note about response body
2026-02-15 01:03:36 +02:00
Karim shoair
ba4d33337f
fix: make browser fetchers type hints always present
2026-02-15 01:03:15 +02:00
Karim shoair
77e825e7be
docs(spider): add a new page for proxy management & blocking
2026-02-15 01:01:43 +02:00
Karim shoair
dee0fd00b8
docs: use more accurate naming for proxy rotation strategy
2026-02-14 23:21:08 +02:00
Karim shoair
0ab54852c4
fix: use more accurate naming for proxy rotation strategy
...
It can be considered the simplest form of round robin since we don't have weights or anything (as was originally planned), but let's change it to avoid confusion or useless debates. Here goes nothing
2026-02-14 23:19:54 +02:00