Karim shoair f093d0cf12 feat(spiders): Add CrawlSpider and CrawlRule

2026-05-10 21:13:16 +03:00

..

templates

feat(spiders): Add CrawlSpider and CrawlRule

2026-05-10 21:13:16 +03:00

__init__.py

style: remove unwanted import from spiders main init file

2026-01-12 01:21:26 +02:00

cache.py

feat(spiders): add a development mode

2026-04-07 04:08:54 +02:00

checkpoint.py

fix(checkpoint): correct error message

2026-02-15 04:36:43 +02:00

engine.py

feat(spiders): add a development mode

2026-04-07 04:08:54 +02:00

links.py

feat(spiders): Add pure URL discovery primitive

2026-05-10 21:12:36 +03:00

request.py

fix: str(value)

2026-04-30 09:52:34 -04:00

result.py

feat(spiders): add a development mode

2026-04-07 04:08:54 +02:00

robotstxt.py

style(spider): removing excessive docstrings and unifying the style with the rest of the repo

2026-04-05 03:43:21 +02:00

scheduler.py

feat(spiders/requests): Use a reliable method for fingerprint generation

2026-01-20 20:21:42 +02:00

session.py

fix: prevent FetcherSession state corruption and lazy session close crash

2026-04-15 21:48:24 -04:00

spider.py

feat(spiders): add a development mode

2026-04-07 04:08:54 +02:00