cb3ab4a011
Merge branch 'main' into dev
2024-11-19 20:48:05 +02:00
b69cc7c983
Fix for the stealth mode on playwright fetcher
...
The JS files weren't being moved while installing with PIP!
2024-11-19 14:35:24 +02:00
50cd40cc42
Merge pull request #9 from D4Vinci/dev
...
v0.2.2
2024-11-16 22:04:03 +02:00
0c6e7708d1
Update README.md
2024-11-16 21:55:53 +02:00
d8a8af8d05
Updating the README to reflect new changes
2024-11-16 21:29:05 +02:00
b60ac7f56a
Change debug mode to be off by default
2024-11-16 21:11:58 +02:00
422c135aae
Adding a file import initialized fetchers for cleaner looking code
...
and lazy people like me :)
2024-11-16 21:10:26 +02:00
cefc95cc3d
Pump version up to 0.2.2
2024-11-16 13:57:33 +02:00
572df6b3b4
Fixing the way Response object handles sub items in some edge cases
...
+ Do it with the least impact on performance
2024-11-16 13:54:55 +02:00
105ec5b067
Update README.md
2024-11-15 23:18:02 +02:00
e2a64a0707
Adding SerpApi as a sponsor
2024-11-15 23:07:59 +02:00
773fcd59bf
Merge pull request #8 from D4Vinci/dev
...
v0.2.1
2024-11-15 18:25:14 +02:00
90e38af552
Correcting the return string for the Response object in all functions/methods
2024-11-15 16:44:47 +02:00
5e8275c3eb
Adding the option to randomize the OS fingerprints with the StealthyFetcher
2024-11-15 16:36:32 +02:00
2abb70218f
Adding the proxy support to browser-based Fetchers
2024-11-15 14:43:03 +02:00
b993adb4a7
Rephrasing some parts
2024-11-15 11:26:41 +02:00
ae7959b4a4
Update README.md
2024-11-15 02:50:24 +02:00
7dd9d3090d
Pumping the version up to 0.2.1
2024-11-15 02:43:29 +02:00
c334755377
Reflecting the new changes in the README and adding small notes
2024-11-15 02:33:47 +02:00
095d50cd75
Making the Response returned from all fetchers same as Adaptor object
...
but with added attributes
2024-11-15 02:23:14 +02:00
b0c2b1818b
Return to the default text behaviour
...
The logic to remove comment tags before returning text was causing errors sometimes so from now on leave `keep_comments` set to True better as it is.
2024-11-14 22:21:45 +02:00
ea81e0284d
Update tests Github action
2024-11-14 16:33:28 +02:00
81f4e18a86
Merge remote-tracking branch 'origin/main' into dev
2024-11-14 16:30:41 +02:00
9e337251ca
Update README.md
2024-11-14 16:09:05 +02:00
e7e9cf8b3d
Adding Evomi as a sponsor
2024-11-14 16:05:37 +02:00
b9c64e8dbf
Update and rename README.md to Adding Evomi as a sponsor
2024-11-14 16:04:48 +02:00
eaa7da27c6
Better logic to handle json responses
2024-11-14 00:03:26 +02:00
d4b896b4e9
Parser - New logic to handle JSON responses passed from Fetchers
2024-11-13 23:14:27 +02:00
ab7b0d45ad
StaticEngine - Fix the headers bug
2024-11-13 23:13:39 +02:00
4e5f7d385a
Merge pull request #5 from D4Vinci/main
...
Keeping `dev` up to date with `main` branch
2024-11-13 22:51:29 +02:00
2b3c9b8ff3
Merge pull request #4 from marksmayo/main
...
Tiny change - py.typed had a space at the end of the file name, which was causing git commands to fail with invalid path
2024-11-13 11:18:53 +02:00
b2993d2fcf
Update and rename py.typeda to py.typed
2024-11-13 21:56:02 +13:00
067809974e
Rename py.typed to py.typeda
2024-11-13 21:55:51 +13:00
4b5f9e12a2
Merge pull request #3 from D4Vinci/dev
...
Releasing version 0.2 (BIG CHANGES)
2024-11-11 19:29:41 +02:00
64c9fe905e
Corrections and rephrasing
2024-11-11 16:40:54 +02:00
bd38fdb347
Corrections and rephrasing
2024-11-11 16:40:46 +02:00
b3418f7f50
Corrections and rephrasing
2024-11-11 16:40:35 +02:00
d6b454dc43
Corrections and rephrasing
2024-11-11 16:40:30 +02:00
eb100e45f7
Corrections and rephrasing
2024-11-11 16:40:21 +02:00
79bf4060f4
Updating find_all examples
2024-11-11 12:51:40 +02:00
e8935b1af8
Update README.md
2024-11-10 23:45:48 +02:00
3d4b427168
Rework Selectors generation
...
- Renamed both `css_selector` and `xpath_selector` both to `generate_css_selector` and `generate_xpath_selector` for clarity and not interrupting the auto-completion while coding.
- Added `generate_full_css_selector` and `generate_full_xpath_selector` methods
2024-11-10 18:19:48 +02:00
de2d65856c
Adding playwright/camoufox tests for cookies and improve the timeout test
2024-11-10 16:31:28 +02:00
239e2c73bf
Correctly get page content after JS Execution
...
- Thanks for @AbdullahY36 for the heads-up.
**Update reference** https://developer.mozilla.org/en-US/docs/Web/API/Document/DOMContentLoaded_event
2024-11-10 16:11:46 +02:00
43045e3eb2
Get page content after JS Execution
...
Thanks for @AbdullahY36
2024-11-10 15:54:44 +02:00
7d2f55bd4c
First version of the 0.2 README
...
I probably forgot some features and made some mistakes here and there so I will review it again later
2024-11-10 00:09:30 +02:00
4b2814404a
Fixing the functions-based filtering logic
2024-11-09 22:32:05 +02:00
6b62579a7e
Making find_all/find methods on steroids
...
Adding the ability to find elements by regex patterns and functions.
2024-11-09 21:25:17 +02:00
b90c8adb02
Adding the argument automatch_domain to all fetchers
2024-11-09 15:38:27 +02:00
03091beb8b
Small clarification
2024-11-09 13:40:50 +02:00
Karim shoair