Commit Graph

1128 Commits

Author SHA1 Message Date
Karim shoair 7ebe3a01a3 docs: removing an irrelevant article 2026-02-25 23:54:24 +02:00
Karim shoair 5b948d34df docs: add the trending badge 2026-02-25 02:06:09 +02:00
Karim shoair 8c9402f9f0 docs: adding new sponsor 2026-02-24 15:28:37 +02:00
Karim shoair c0aec234eb docs: update sponsorship plans and corrections 2026-02-24 15:19:23 +02:00
Karim shoair cd13a695cb docs: adjustments to website metadata 2026-02-18 04:33:39 +02:00
Karim shoair a9b785aa8f docs: add media preview image 2026-02-18 04:26:09 +02:00
Karim shoair f21e7462e4 docs: fix cookie consent 2026-02-15 15:11:48 +02:00
Karim shoair 1bbb18ad8e build: fix readme path for pypi 2026-02-15 07:16:28 +02:00
Karim shoair 04d796b821 v0.4 2026-02-15 07:13:28 +02:00
Karim shoair 95ad2842e9 docs: add an entry for the 0.4 version 2026-02-15 04:40:43 +02:00
Karim shoair b19fa5e694 fix(checkpoint): correct error message 2026-02-15 04:36:43 +02:00
Karim shoair e35ba3455c test: add tests for spiders engine
Automated tests written by AI
2026-02-15 04:35:28 +02:00
Karim shoair 02b11c535e fix(spiders): corrections and removal of dead code 2026-02-15 04:25:32 +02:00
Karim shoair b8b9a7f864 docs: general correction across all the pages
Automated. I don't know how I missed all of that!
2026-02-15 03:58:51 +02:00
Karim shoair 93bcb1681b style: docstrings corrections for accuracy 2026-02-15 03:57:14 +02:00
Karim shoair 1bf6bb8d65 docs: update the images urls to use main branch 2026-02-15 03:29:57 +02:00
Karim shoair 7b8fc911e1 docs: add a page for spiders advanced usage 2026-02-15 02:40:55 +02:00
Karim shoair 7b4523af8e docs: update the titles for all files 2026-02-15 02:35:39 +02:00
Karim shoair c3374bce41 docs: add a note about response body 2026-02-15 01:03:36 +02:00
Karim shoair ba4d33337f fix: make browser fetchers type hints always present 2026-02-15 01:03:15 +02:00
Karim shoair 77e825e7be docs(spider): add a new page for proxy management & blocking 2026-02-15 01:01:43 +02:00
Karim shoair dee0fd00b8 docs: use more accurate naming for proxy rotation strategy 2026-02-14 23:21:08 +02:00
Karim shoair 0ab54852c4 fix: use more accurate naming for proxy rotation strategy
It can be considered the simplest form of round robin since we don't have weights or anything (as was originally planned), but let's change it to avoid confusion or useless debates. Here goes nothing
2026-02-14 23:19:54 +02:00
Karim shoair c94ebd2fa9 docs(spiders): add a page to explain sessions logic 2026-02-14 17:19:55 +02:00
Karim shoair 108e11fc30 docs: add a new issue template for documentation issues 2026-02-14 17:08:32 +02:00
Karim shoair dddb179c50 docs: add new api references 2026-02-14 17:07:55 +02:00
Karim shoair a8f701f8ab docs(spiders): add a new page for requests & responses 2026-02-14 04:04:18 +02:00
Karim shoair 2997d562d5 test: remove irrelevent test 2026-02-14 03:34:41 +02:00
Karim shoair e785cf26ce fix(parser)!: Optimize parser for repeated operations 2026-02-14 03:34:13 +02:00
Karim shoair d0a5a01299 test: update spider check 2026-02-14 02:51:39 +02:00
Karim shoair 6a0c323482 docs: adding a new Pick Your Path section to the overview page 2026-02-14 00:43:05 +02:00
Karim shoair c6a662eb38 docs(dynamic pages): add an important warning 2026-02-13 18:45:44 +02:00
Karim shoair 2eea66dad1 style(spiders): Lower the default number of concurrent requests 2026-02-13 17:32:17 +02:00
Karim shoair a62330d2f1 fix: add typed overloads to Selectors.get() for proper default type inference
Type checkers now correctly infer the return type based on the default value:
- .get() → TextHandler | None
- .get("") → TextHandler | str
- .get(0) → TextHandler | int
2026-02-13 17:30:55 +02:00
Karim shoair 1c2c7c55bf docs: use a better looking architecture image instead of mermaid 2026-02-12 15:17:58 +02:00
Karim shoair 14143dd0f0 docs: add getting started page to the spiders section 2026-02-12 04:45:39 +02:00
Karim shoair bbb8c26df0 docs: Improve spider architecture page 2026-02-12 04:30:16 +02:00
Karim shoair d0b2cec849 docs: simplify the architecture mermaid 2026-02-12 03:30:14 +02:00
Karim shoair 5a599445e2 docs: update libraries 2026-02-12 03:29:41 +02:00
Karim shoair 10cd46ee23 docs: add the first page of the spiders section 2026-02-11 03:55:23 +02:00
Karim shoair 8902034418 docs: improve wording, style, and use more visual ways 2026-02-11 03:04:35 +02:00
Karim shoair 6ac40ac3af build: adjustments to build file for PyPi 2026-02-11 00:29:20 +02:00
Karim shoair a38f5af615 docs: fix image in the interactive shell page 2026-02-11 00:19:38 +02:00
Karim shoair b52d35c6ec docs: update beautifulsoup migration guide 2026-02-10 22:13:04 +02:00
Karim shoair 8e4b4a22c9 docs: updating extract commans page 2026-02-10 22:09:55 +02:00
Karim shoair 7fb57d667c docs: updating Interactive shell page and some corrections 2026-02-10 22:07:55 +02:00
Karim shoair a72886f158 docs: update camoufox instructions for StealthyFetcher 2026-02-10 21:58:08 +02:00
Karim shoair d4766a070b build: update the website description 2026-02-10 21:54:17 +02:00
Karim shoair 0489923b06 build: pump up the version status 2026-02-10 21:53:00 +02:00
Karim shoair d3ee9a6cbb ops: remove branch v4 from workflows 2026-02-10 21:51:22 +02:00