Karim shoair
93be416572
feat(TextHandler): Now regex methods return TextHandler/TextHandlers
2025-01-30 02:15:09 +02:00
Karim shoair
1d5fcc060d
feat(TextHandler): Make slicing return TextHandlers + autocompletion fixes
...
and access by index return `TextHandler`
2025-01-29 14:22:47 +02:00
Karim shoair
70ffdd09e2
feat(TextHandler): Make split string method return Texthandlers
2025-01-29 01:22:07 +02:00
Karim shoair
5047e886a5
style(autocompletion): Improving type hints for custom types
...
This will provide a better autocompletion experience inside IDEs, commit affects:
- TextHandler
- AttributesHandler
2025-01-29 00:58:14 +02:00
Karim shoair
5be8c2a95e
style(Fetchers): Setting correct type hint for wait_selector_state argument
2024-12-19 13:22:12 +02:00
Karim shoair
193827e27b
refactor(api)!: Unifying log under 1 logger and removing debug parameter
...
So now you control the logging and the debugging from the shell through the logger with the name 'scrapling'
2024-12-11 21:41:37 +02:00
Karim shoair
9f0001af26
feat: logging for response status
2024-12-11 20:14:32 +02:00
Karim shoair
45e86f50a3
Adding empty methods (get/get_all/extract/extract_all)
...
For easy copy-paste from Scrapy/parsel code when needed :)
2024-12-04 14:28:37 +02:00
Karim shoair
31e838ce9b
Make standard string methods return TextHandler again instead of str
2024-12-04 14:27:36 +02:00
Karim shoair
1a17b2ce46
Sorting all library imports with isort
2024-11-30 14:02:06 +02:00
Karim shoair
97fecc9d5f
Style adjustments by flake8
2024-11-29 21:14:52 +02:00
Karim shoair
f443d774c1
Fixing the doc-string to match Sphinx
2024-11-19 14:33:54 +02:00
Karim shoair
eaa7da27c6
Better logic to handle json responses
2024-11-14 00:03:26 +02:00
Karim shoair
3d4b427168
Rework Selectors generation
...
- Renamed both `css_selector` and `xpath_selector` both to `generate_css_selector` and `generate_xpath_selector` for clarity and not interrupting the auto-completion while coding.
- Added `generate_full_css_selector` and `generate_full_xpath_selector` methods
2024-11-10 18:19:48 +02:00
Karim shoair
5e848ef046
Adding new class type TextHandlers
2024-11-06 21:03:19 +02:00
Karim shoair
a1fd5ddc7e
Correcting headless argument type
2024-11-06 20:18:44 +02:00
Karim shoair
145c03daff
Big structure changes (check commit description)
...
- Moved most of the parser functions/files to the core package.
- Converted tools file to a package and made separate files for similar functions.
- Now all fetcher engines return a Response object
- Instead of selecting an engine to use and passing config to it, we have separate fetcher classes so the user can choose what to use while importing.
- I added a new custom fetcher so the user can create and use an engine.
- More...
2024-11-03 01:04:02 +02:00