Product 1
+Description 1
+Description 1
+Description 2
+Description 1
+Description 2
+This is product 1
+ $10.99 +This is product 2
+ $20.99 +This is product 3
+ $15.99 +This is product 1
\n $10.99\nThis is product 1
+ $10.99 +{"some_key": "some_value"}
' + ``` + The `json` method can be used directly: + ```python + >>> page.json() + {'some_key': 'some_value'} + ``` + For JSON responses, the [Selector](#selector) class keeps a raw copy of the content it receives. When `.json()` is called, it checks for that raw copy first and converts it to JSON. If the raw copy is unavailable (as with sub-elements), it checks the current element's text content, then falls back to `get_all_text`. + +- The `.clean()` method removes all whitespace and consecutive spaces, returning a new `TextHandler` instance: +```python +>>> TextHandler('\n wonderful idea, \reh?').clean() +'wonderful idea, eh?' +``` +The `remove_entities` argument causes `clean` to replace HTML entities with their corresponding characters. + +- The `.sort()` method sorts the string characters: +```python +>>> TextHandler('acb').sort() +'abc' +``` +Or do it in reverse: +```python +>>> TextHandler('acb').sort(reverse=True) +'cba' +``` + +This class is returned in place of strings nearly everywhere in the library. + +## TextHandlers +This class inherits from standard lists, adding `re` and `re_first` as new methods. + +The `re_first` method runs `re` on each [TextHandler](#texthandler) and returns the first result, or `None`. + +## AttributesHandler +This is a read-only version of Python's standard dictionary, or `dict`, used solely to store the attributes of each element/[Selector](#selector) instance. +```python +>>> print(page.find('script').attrib) +{'id': 'page-data', 'type': 'application/json'} +>>> type(page.find('script').attrib).__name__ +'AttributesHandler' +``` +Because it's read-only, it will use fewer resources than the standard dictionary. Still, it has the same dictionary method and properties, except those that allow you to modify/override the data. + +It currently adds two extra simple methods: + +- The `search_values` method + + Searches the current attributes by values (rather than keys) and returns a dictionary of each matching item. + + A simple example would be + ```python + >>> for i in page.find('script').attrib.search_values('page-data'): + print(i) + {'id': 'page-data'} + ``` + But this method provides the `partial` argument as well, which allows you to search by part of the value: + ```python + >>> for i in page.find('script').attrib.search_values('page', partial=True): + print(i) + {'id': 'page-data'} + ``` + A more practical example is using it with `find_all` to find all elements that have a specific value in their attributes: + ```python + >>> page.find_all(lambda element: list(element.attrib.search_values('product'))) + [£51.77
' parent='£51.77
' parent='£53.74
' parent='£50.10
' parent='£47.82
' parent=',
+ ,
+ ,
+...]
+```
+Find all div elements with a class that equals `quote`.
+```python
+>>> page.find_all('div', class_='quote')
+[ ]
+```
+Find all elements that have children.
+```python
+>>> page.find_all(lambda element: len(element.children) > 0)
+[