 Karim shoair
|
6b62579a7e
|
Making find_all/find methods on steroids
Adding the ability to find elements by regex patterns and functions.
|
2024-11-09 21:25:17 +02:00 |
|
|
Karim shoair
|
b90c8adb02
|
Adding the argument automatch_domain to all fetchers
|
2024-11-09 15:38:27 +02:00 |
|
|
Karim shoair
|
03091beb8b
|
Small clarification
|
2024-11-09 13:40:50 +02:00 |
|
|
Karim shoair
|
fd7d787ab0
|
Add extra_headers argument to PW and isolate google referer feature from stealth mode as google_search
|
2024-11-09 00:54:11 +02:00 |
|
|
Karim shoair
|
ee8f78feb1
|
Update camo.py
|
2024-11-09 00:48:11 +02:00 |
|
|
Karim shoair
|
fd34cd9afa
|
Adding arguments google_search and extra_headers to StealthyFetcher
|
2024-11-09 00:43:24 +02:00 |
|
|
Karim shoair
|
530b54d964
|
Clearer doc-string
|
2024-11-09 00:17:41 +02:00 |
|
|
Karim shoair
|
1b015bbd07
|
Type correction
|
2024-11-08 23:59:12 +02:00 |
|
|
Karim shoair
|
b919536527
|
Updating the keywords whitelisting logic in find/find_all functions
|
2024-11-07 12:56:32 +02:00 |
|
|
Karim shoair
|
51ce40a561
|
Update ROADMAP.md
|
2024-11-07 00:44:23 +02:00 |
|
|
Karim shoair
|
91f6b46e6d
|
Adding new filter and search functions to parser
|
2024-11-07 00:31:14 +02:00 |
|
|
Karim shoair
|
846a185b49
|
Updating parser tests to use find and css_first functions
|
2024-11-07 00:02:36 +02:00 |
|
|
Karim shoair
|
b25d2ee79b
|
Adding new find_all and find functions to parser
|
2024-11-07 00:01:14 +02:00 |
|
|
Karim shoair
|
6b40af426f
|
Better logic for css_first and xpath_first
|
2024-11-06 22:14:33 +02:00 |
|
|
Karim shoair
|
5e848ef046
|
Adding new class type TextHandlers
|
2024-11-06 21:03:19 +02:00 |
|
|
Karim shoair
|
7a84511b7a
|
Making Adaptor and Adaptor re/re_first arguments consistent with the TextHandler ones
|
2024-11-06 20:47:21 +02:00 |
|
|
Karim shoair
|
7af75f78a5
|
Better logic for Adaptors re_first method
|
2024-11-06 20:24:30 +02:00 |
|
|
Karim shoair
|
a1fd5ddc7e
|
Correcting headless argument type
|
2024-11-06 20:18:44 +02:00 |
|
|
Karim shoair
|
a0a3e62075
|
Adding addons and humanize arguments to StealthyFetcher
|
2024-11-06 20:14:42 +02:00 |
|
|
Karim shoair
|
5ad2126030
|
Small speed boost for fetching by some caching
|
2024-11-06 19:56:39 +02:00 |
|
|
Karim shoair
|
a1513ba769
|
Update tests.yml
|
2024-11-06 12:54:52 +02:00 |
|
|
Karim shoair
|
b542b5cc39
|
Recaching TOX environments
|
2024-11-06 12:50:14 +02:00 |
|
|
Karim shoair
|
c30853ee2c
|
Update tox.ini
|
2024-11-06 12:39:38 +02:00 |
|
|
Karim shoair
|
fc30cfed4c
|
Update tests.yml
|
2024-11-06 12:36:46 +02:00 |
|
|
Karim shoair
|
cd1ff846a7
|
Update ROADMAP.md
|
2024-11-06 12:31:57 +02:00 |
|
|
Karim shoair
|
d632bb14af
|
Moving parser tests to a better structure
and covering a bit more parts
|
2024-11-06 12:30:41 +02:00 |
|
|
Karim shoair
|
5548941cf1
|
Correcting return type for css_first and xpath_first
|
2024-11-06 12:28:43 +02:00 |
|
|
Karim shoair
|
e4eb442709
|
Adding tests for PlayWrightFetcher class
|
2024-11-06 12:21:55 +02:00 |
|
|
Karim shoair
|
4222626ec1
|
Adding tests for Fetcher class
|
2024-11-06 12:21:18 +02:00 |
|
|
Karim shoair
|
4400363146
|
Renaming fetchers tests folder for readability
|
2024-11-06 12:21:06 +02:00 |
|
|
Karim shoair
|
9a7f489eb7
|
make tests verbose for easier debugging later
|
2024-11-06 12:20:05 +02:00 |
|
|
Karim shoair
|
10bcdfb596
|
Moving bypasses folder deeper
|
2024-11-06 12:19:26 +02:00 |
|
|
Karim shoair
|
6cf506cb22
|
PlaywrightEngine - Validate CDP URLs in all cases
|
2024-11-06 11:24:56 +02:00 |
|
|
Karim shoair
|
6497b1b559
|
Type correction
|
2024-11-06 02:20:33 +02:00 |
|
|
Karim shoair
|
24806aecdc
|
Update .gitignore
|
2024-11-05 23:41:57 +02:00 |
|
|
Karim shoair
|
3622040440
|
Adding css_first and xpath_first for easier usage
|
2024-11-05 23:41:51 +02:00 |
|
|
Karim shoair
|
009c2914aa
|
Fixing re_first logic in Adaptors type
|
2024-11-05 22:59:47 +02:00 |
|
|
Karim shoair
|
d50497dff3
|
Update .gitignore
|
2024-11-05 22:56:57 +02:00 |
|
|
Karim shoair
|
ca4b5f205c
|
Since tests can finally now run in Github actions without issues
Let's miss it up again lol
|
2024-11-05 13:10:51 +02:00 |
|
|
Karim shoair
|
2a275c436c
|
Update tests.yml
|
2024-11-05 13:02:11 +02:00 |
|
|
Karim shoair
|
69cfbe45be
|
Update tests.yml
|
2024-11-05 12:59:39 +02:00 |
|
|
Karim shoair
|
6f91d06b46
|
Update tests.yml
|
2024-11-05 12:57:57 +02:00 |
|
|
Karim shoair
|
2020214784
|
please work
|
2024-11-05 11:45:59 +02:00 |
|
|
Karim shoair
|
92d002032d
|
Update tests.yml
|
2024-11-05 11:44:10 +02:00 |
|
|
Karim shoair
|
1bbb5dd75a
|
Update tests.yml
|
2024-11-05 11:41:58 +02:00 |
|
|
Karim shoair
|
d4358d32a8
|
Update tests.yml
|
2024-11-05 11:38:38 +02:00 |
|
|
Karim shoair
|
a60662af4a
|
Update camo.py
|
2024-11-05 11:38:35 +02:00 |
|
|
Karim shoair
|
8933a99a6e
|
Update tests.yml
|
2024-11-05 11:29:28 +02:00 |
|
|
Karim shoair
|
f200e9b290
|
looks like playwright need to run as normal user
|
2024-11-05 11:28:12 +02:00 |
|
|
Karim shoair
|
1dd04f8250
|
Update tests.yml
|
2024-11-05 02:39:15 +02:00 |
|