Commit Graph

1164 Commits

Author SHA1 Message Date
Karim shoair e34651d887 fix(stealth): improve stealth mode by removing unnecessary scripts
It doesn't add anything to the table as before (it might turn out I was wrong and add them again lol)
2026-02-27 03:50:14 +02:00
Karim shoair b50e8f050f fix(mcp): make mcp use less tokens by striping useless tags 2026-02-27 03:39:48 +02:00
Karim shoair d750fec468 fix(solver): Solve CF faster and handle websites that show captcha twice 2026-02-27 02:32:21 +02:00
Karim shoair ef29568cd0 docs: add a code snippet on how to do scrapling install from code 2026-02-27 01:17:54 +02:00
Karim shoair 5f885ae5f5 docs(mcp): update cursor url 2026-02-27 01:03:56 +02:00
Karim shoair efb320bb8c docs: style adjustments 2026-02-27 00:49:00 +02:00
Karim shoair a8359a4878 build: pump version up and the deps 2026-02-27 00:32:25 +02:00
Karim shoair 921314c314 fix: complete MCP schema validation for remaining bare array types
- Fix params (Dict|List|Tuple → Dict), urls (Tuple[str,...] → List[str]),
- Renamed _NormalizeCredentials/_ContentTranslator to snake_case.
- Also, raise a ValueError on invalid credentials instead of returning None silently.
2026-02-27 00:28:44 +02:00
Karim shoair 86e0f0f250 docs: update deps for the website 2026-02-27 00:11:02 +02:00
Karim shoair 53dd360296 docs: add mcp integrated badge 2026-02-26 23:56:42 +02:00
Karim shoair 2904441b42 fix: make MCP get schemas validator-safe (#137) 2026-02-26 23:54:48 +02:00
Karim shoair 6c12c196ac Merge branch 'dev' into fix/mcp-schema-auth-cookies 2026-02-26 23:54:18 +02:00
Karim shoair bcc93f392d Merge branch 'main' into dev 2026-02-26 18:57:27 +02:00
Karim shoair b54a49b717 ops: Upgrade GitHub Actions to latest versions (#144) 2026-02-26 18:56:54 +02:00
Karim shoair 46fd1506dc Merge branch 'main' into upgrade-github-actions-node24-general 2026-02-26 18:56:36 +02:00
Karim shoair 908ede1c64 ops: Upgrade GitHub Actions for Node 24 compatibility (#143) 2026-02-26 18:56:20 +02:00
Karim shoair ccce0fc552 Merge branch 'main' into upgrade-github-actions-node24 2026-02-26 18:55:45 +02:00
Karim shoair 9708354c80 Fix: Improve regex precision for Cloudflare challenge detection (#133) 2026-02-26 18:53:13 +02:00
Karim shoair 50e0be5c1c Merge branch 'dev' into fix/cloudflare-regex 2026-02-26 18:52:37 +02:00
Karim shoair 558e9a6fa0 Merge branch 'main' into dev 2026-02-25 23:55:53 +02:00
Karim shoair 7ebe3a01a3 docs: removing an irrelevant article 2026-02-25 23:54:24 +02:00
Salman Muin Kayser Chishti 8de47c9bd7 Upgrade GitHub Actions to latest versions
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
2026-02-25 09:21:41 +00:00
Salman Muin Kayser Chishti 0aabceb74e Upgrade GitHub Actions for Node 24 compatibility
Signed-off-by: Salman Muin Kayser Chishti <13schishti@gmail.com>
2026-02-25 09:21:38 +00:00
Karim shoair 6943ec27f8 docs: typo correction 2026-02-25 02:23:36 +02:00
Karim shoair e7b0fe7b46 Merge branch 'main' into dev 2026-02-25 02:23:08 +02:00
Karim shoair 5b948d34df docs: add the trending badge 2026-02-25 02:06:09 +02:00
Karim shoair d934fe876c Merge branch 'main' into dev 2026-02-25 01:59:14 +02:00
Karim shoair 8c9402f9f0 docs: adding new sponsor 2026-02-24 15:28:37 +02:00
Karim shoair c0aec234eb docs: update sponsorship plans and corrections 2026-02-24 15:19:23 +02:00
Robin Ede b77a1b9419 fix: make MCP get schemas validator-safe
Use JSON-object input types for cookies and basic-auth fields in get and bulk_get so strict MCP schema validators can register tools reliably.

Normalize auth dictionaries to the tuple format expected by fetchers to preserve runtime behavior.
2026-02-23 19:49:39 -06:00
Karim shoair b503f537ce docs: corrections to the sponsorship page 2026-02-23 03:49:16 +02:00
Karim shoair a0cc3857d0 docs: corrections to the sponsorship page 2026-02-23 03:27:43 +02:00
Karim shoair aed842c42e docs: update sponsorship plans 2026-02-23 03:25:18 +02:00
Karim shoair f537613921 docs: shortening the demo code in the README 2026-02-23 03:04:27 +02:00
Karim shoair a6beaaba89 docs: adjustments to sponsors placement 2026-02-23 02:58:25 +02:00
Karim shoair 4072c5e83d docs: update readme URLs 2026-02-23 02:45:37 +02:00
Karim shoair 1f5a7d5d2c ops: add mcp registry file 2026-02-23 02:31:28 +02:00
RinZ27 aa90dda439 fix: improve regex precision for Cloudflare challenge detection 2026-02-18 14:02:31 +07:00
Karim shoair 2b56a87e36 Merge branch 'main' into dev 2026-02-18 04:47:32 +02:00
Karim shoair cd13a695cb docs: adjustments to website metadata 2026-02-18 04:33:39 +02:00
Karim shoair a9b785aa8f docs: add media preview image 2026-02-18 04:26:09 +02:00
Karim shoair 60eea3ba68 docs: add media preview image 2026-02-18 00:04:53 +02:00
Karim shoair f21e7462e4 docs: fix cookie consent 2026-02-15 15:11:48 +02:00
Karim shoair 1bbb18ad8e build: fix readme path for pypi 2026-02-15 07:16:28 +02:00
Karim shoair 04d796b821 v0.4 2026-02-15 07:13:28 +02:00
Karim shoair 95ad2842e9 docs: add an entry for the 0.4 version 2026-02-15 04:40:43 +02:00
Karim shoair b19fa5e694 fix(checkpoint): correct error message 2026-02-15 04:36:43 +02:00
Karim shoair e35ba3455c test: add tests for spiders engine
Automated tests written by AI
2026-02-15 04:35:28 +02:00
Karim shoair 02b11c535e fix(spiders): corrections and removal of dead code 2026-02-15 04:25:32 +02:00
Karim shoair b8b9a7f864 docs: general correction across all the pages
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00