Commit Graph

1154 Commits

Author SHA1 Message Date
Karim shoair 2904441b42 fix: make MCP get schemas validator-safe (#137) 2026-02-26 23:54:48 +02:00
Karim shoair 6c12c196ac Merge branch 'dev' into fix/mcp-schema-auth-cookies 2026-02-26 23:54:18 +02:00
Karim shoair bcc93f392d Merge branch 'main' into dev 2026-02-26 18:57:27 +02:00
Karim shoair b54a49b717 ops: Upgrade GitHub Actions to latest versions (#144) 2026-02-26 18:56:54 +02:00
Karim shoair 46fd1506dc Merge branch 'main' into upgrade-github-actions-node24-general 2026-02-26 18:56:36 +02:00
Karim shoair 908ede1c64 ops: Upgrade GitHub Actions for Node 24 compatibility (#143) 2026-02-26 18:56:20 +02:00
Karim shoair ccce0fc552 Merge branch 'main' into upgrade-github-actions-node24 2026-02-26 18:55:45 +02:00
Karim shoair 9708354c80 Fix: Improve regex precision for Cloudflare challenge detection (#133) 2026-02-26 18:53:13 +02:00
Karim shoair 50e0be5c1c Merge branch 'dev' into fix/cloudflare-regex 2026-02-26 18:52:37 +02:00
Karim shoair 558e9a6fa0 Merge branch 'main' into dev 2026-02-25 23:55:53 +02:00
Karim shoair 7ebe3a01a3 docs: removing an irrelevant article 2026-02-25 23:54:24 +02:00
Salman Muin Kayser Chishti 8de47c9bd7 Upgrade GitHub Actions to latest versions
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
2026-02-25 09:21:41 +00:00
Salman Muin Kayser Chishti 0aabceb74e Upgrade GitHub Actions for Node 24 compatibility
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
2026-02-25 09:21:38 +00:00
Karim shoair 6943ec27f8 docs: typo correction 2026-02-25 02:23:36 +02:00
Karim shoair e7b0fe7b46 Merge branch 'main' into dev 2026-02-25 02:23:08 +02:00
Karim shoair 5b948d34df docs: add the trending badge 2026-02-25 02:06:09 +02:00
Karim shoair d934fe876c Merge branch 'main' into dev 2026-02-25 01:59:14 +02:00
Karim shoair 8c9402f9f0 docs: adding new sponsor 2026-02-24 15:28:37 +02:00
Karim shoair c0aec234eb docs: update sponsorship plans and corrections 2026-02-24 15:19:23 +02:00
Robin Ede b77a1b9419 fix: make MCP get schemas validator-safe
Use JSON-object input types for cookies and basic-auth fields in get and bulk_get so strict MCP schema validators can register tools reliably.

Normalize auth dictionaries to the tuple format expected by fetchers to preserve runtime behavior.
2026-02-23 19:49:39 -06:00
Karim shoair b503f537ce docs: corrections to the sponsorship page 2026-02-23 03:49:16 +02:00
Karim shoair a0cc3857d0 docs: corrections to the sponsorship page 2026-02-23 03:27:43 +02:00
Karim shoair aed842c42e docs: update sponsorship plans 2026-02-23 03:25:18 +02:00
Karim shoair f537613921 docs: shortening the demo code in the README 2026-02-23 03:04:27 +02:00
Karim shoair a6beaaba89 docs: adjustments to sponsors placement 2026-02-23 02:58:25 +02:00
Karim shoair 4072c5e83d docs: update readme URLs 2026-02-23 02:45:37 +02:00
Karim shoair 1f5a7d5d2c ops: add mcp registry file 2026-02-23 02:31:28 +02:00
RinZ27 aa90dda439 fix: improve regex precision for Cloudflare challenge detection 2026-02-18 14:02:31 +07:00
Karim shoair 2b56a87e36 Merge branch 'main' into dev 2026-02-18 04:47:32 +02:00
Karim shoair cd13a695cb docs: adjustments to website metadata 2026-02-18 04:33:39 +02:00
Karim shoair a9b785aa8f docs: add media preview image 2026-02-18 04:26:09 +02:00
Karim shoair 60eea3ba68 docs: add media preview image 2026-02-18 00:04:53 +02:00
Karim shoair f21e7462e4 docs: fix cookie consent 2026-02-15 15:11:48 +02:00
Karim shoair 1bbb18ad8e build: fix readme path for pypi 2026-02-15 07:16:28 +02:00
Karim shoair 04d796b821 v0.4 2026-02-15 07:13:28 +02:00
Karim shoair 95ad2842e9 docs: add an entry for the 0.4 version 2026-02-15 04:40:43 +02:00
Karim shoair b19fa5e694 fix(checkpoint): correct error message 2026-02-15 04:36:43 +02:00
Karim shoair e35ba3455c test: add tests for spiders engine
Automated tests written by AI
2026-02-15 04:35:28 +02:00
Karim shoair 02b11c535e fix(spiders): corrections and removal of dead code 2026-02-15 04:25:32 +02:00
Karim shoair b8b9a7f864 docs: general correction across all the pages
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00
Karim shoair 93bcb1681b style: docstrings corrections for accuracy 2026-02-15 03:57:14 +02:00
Karim shoair 1bf6bb8d65 docs: update the images urls to use main branch 2026-02-15 03:29:57 +02:00
Karim shoair 7b8fc911e1 docs: add a page for spiders advanced usage 2026-02-15 02:40:55 +02:00
Karim shoair 7b4523af8e docs: update the titles for all files 2026-02-15 02:35:39 +02:00
Karim shoair c3374bce41 docs: add a note about response body 2026-02-15 01:03:36 +02:00
Karim shoair ba4d33337f fix: make browser fetchers type hints always present 2026-02-15 01:03:15 +02:00
Karim shoair 77e825e7be docs(spider): add a new page for proxy management & blocking 2026-02-15 01:01:43 +02:00
Karim shoair dee0fd00b8 docs: use more accurate naming for proxy rotation strategy 2026-02-14 23:21:08 +02:00
Karim shoair 0ab54852c4 fix: use more accurate naming for proxy rotation strategy
It can be considered the simplest form of round robin since we don't have weights or anything (as was originally planned), but let's change it to avoid confusion or useless debates. Here goes nothing
2026-02-14 23:19:54 +02:00
Karim shoair c94ebd2fa9 docs(spiders): add a page to explain sessions logic 2026-02-14 17:19:55 +02:00