 Karim shoair
|
15b7e3acee
|
Stop using generated headers by browserforge
It turns out its headers format is pretty outdated, which made Google reCaptcha not work sometimes
|
2024-11-24 13:47:21 +02:00 |
|
|
Karim shoair
|
7f330efc52
|
Turn-off the hide_canvas option by default
|
2024-11-24 13:44:16 +02:00 |
|
|
Karim shoair
|
58151c12e8
|
Update the minimum browser version for headers generated
|
2024-11-24 13:41:06 +02:00 |
|
|
Karim shoair
|
e94c5034e3
|
Merge pull request #15 from D4Vinci/docs
Doc adjustments to use Sphinx soon
|
2024-11-23 17:52:12 +02:00 |
|
|
Karim shoair
|
1929d9bebb
|
Fix for docs
|
2024-11-23 17:48:05 +02:00 |
|
|
Karim shoair
|
e51556f80c
|
Merge branch 'main' into docs
|
2024-11-23 16:48:22 +02:00 |
|
|
Karim shoair
|
4cea8c9926
|
Merge pull request #14 from D4Vinci/dev
v0.2.5
|
2024-11-23 16:39:26 +02:00 |
|
|
Karim shoair
|
0e01c1cc03
|
Update test_general.py
|
2024-11-23 16:24:25 +02:00 |
|
|
Karim shoair
|
34b645c9a5
|
Fix for playwright tests on GitHub actions
|
2024-11-23 16:19:50 +02:00 |
|
|
Karim shoair
|
e7f2a83e16
|
Increasing the time a little bit for the performance test
It's prolonged on GitHub Actions for obvious reasons
|
2024-11-23 16:12:00 +02:00 |
|
|
Karim shoair
|
2b925b4a33
|
Pumping version up to 0.2.5
|
2024-11-23 16:06:11 +02:00 |
|
|
Karim shoair
|
454b79e00f
|
Make tests run in parallel on GitHub actions
|
2024-11-23 16:04:47 +02:00 |
|
|
Karim shoair
|
723a545061
|
Fixing the "Unknown Status Code" test
|
2024-11-23 16:01:51 +02:00 |
|
|
Karim shoair
|
7017823136
|
Covering more parts in Playwright tests
|
2024-11-23 15:57:59 +02:00 |
|
|
Karim shoair
|
4d9a494e35
|
Covering more parts in StealthyFetcher tests
|
2024-11-23 15:55:50 +02:00 |
|
|
Karim shoair
|
f33ff247dd
|
Adding tests for response encoding and response status text
|
2024-11-23 15:55:21 +02:00 |
|
|
Karim shoair
|
073ab2c7e3
|
Universally handling different response encoding and charsets for all responses
Thanks for @andyfcx
|
2024-11-23 15:40:41 +02:00 |
|
|
Karim shoair
|
869412761a
|
Fix for the wait_selector argument resolving to more than 1 element
|
2024-11-22 22:15:52 +02:00 |
|
|
Karim shoair
|
18eb96adb1
|
Merge pull request #13 from andyfcx/main
fix: make sure to default utf-8 as encoding and strip unwanted single or double quotes
|
2024-11-21 11:21:45 +02:00 |
|
|
andyfcx
|
63112bfc50
|
fix: make sure to default utf-8 as encoding and strip unwanted single or double quotes
|
2024-11-21 14:54:38 +08:00 |
|
|
Karim shoair
|
3f39bd52d4
|
Merge branch 'main' into docs
|
2024-11-20 14:36:30 +02:00 |
|
|
Karim shoair
|
e9b0102d55
|
Merge pull request #11 from D4Vinci/dev
v0.2.4
|
2024-11-20 13:35:06 +02:00 |
|
|
Karim shoair
|
17d7934484
|
Pump version to 0.2.4
|
2024-11-20 13:27:39 +02:00 |
|
|
Karim shoair
|
19ad82caef
|
Calculate status text manually if it's not returned by PlayWright API
|
2024-11-20 13:27:18 +02:00 |
|
|
Karim shoair
|
4c74d9bc97
|
Fixing a bug with reading response bytes in playwright/camoufox when network_idle is used
PlayWright doesn't provide a way to get the response in bytes after all wait ends like `page.content()` so that's more efficient to do anyway
|
2024-11-20 12:33:54 +02:00 |
|
|
Karim shoair
|
14738030e0
|
Merge pull request #10 from D4Vinci/dev
v0.2.3
|
2024-11-20 01:48:17 +02:00 |
|
|
Karim shoair
|
649f4cfae7
|
Pumping up camoufox version
|
2024-11-20 01:41:46 +02:00 |
|
|
Karim shoair
|
526c516693
|
Pump version up to 0.2.3
|
2024-11-20 01:28:01 +02:00 |
|
|
Karim shoair
|
cb3ab4a011
|
Merge branch 'main' into dev
|
2024-11-19 20:48:05 +02:00 |
|
|
Karim shoair
|
b69cc7c983
|
Fix for the stealth mode on playwright fetcher
The JS files weren't being moved while installing with PIP!
|
2024-11-19 14:35:24 +02:00 |
|
|
Karim shoair
|
f443d774c1
|
Fixing the doc-string to match Sphinx
|
2024-11-19 14:33:54 +02:00 |
|
|
Karim shoair
|
50cd40cc42
|
Merge pull request #9 from D4Vinci/dev
v0.2.2
|
2024-11-16 22:04:03 +02:00 |
|
|
Karim shoair
|
0c6e7708d1
|
Update README.md
|
2024-11-16 21:55:53 +02:00 |
|
|
Karim shoair
|
d8a8af8d05
|
Updating the README to reflect new changes
|
2024-11-16 21:29:05 +02:00 |
|
|
Karim shoair
|
b60ac7f56a
|
Change debug mode to be off by default
|
2024-11-16 21:11:58 +02:00 |
|
|
Karim shoair
|
422c135aae
|
Adding a file import initialized fetchers for cleaner looking code
and lazy people like me :)
|
2024-11-16 21:10:26 +02:00 |
|
|
Karim shoair
|
cefc95cc3d
|
Pump version up to 0.2.2
|
2024-11-16 13:57:33 +02:00 |
|
|
Karim shoair
|
572df6b3b4
|
Fixing the way Response object handles sub items in some edge cases
+ Do it with the least impact on performance
|
2024-11-16 13:54:55 +02:00 |
|
|
Karim shoair
|
105ec5b067
|
Update README.md
|
2024-11-15 23:18:02 +02:00 |
|
|
Karim shoair
|
e2a64a0707
|
Adding SerpApi as a sponsor
|
2024-11-15 23:07:59 +02:00 |
|
|
Karim shoair
|
773fcd59bf
|
Merge pull request #8 from D4Vinci/dev
v0.2.1
|
2024-11-15 18:25:14 +02:00 |
|
|
Karim shoair
|
90e38af552
|
Correcting the return string for the Response object in all functions/methods
|
2024-11-15 16:44:47 +02:00 |
|
|
Karim shoair
|
5e8275c3eb
|
Adding the option to randomize the OS fingerprints with the StealthyFetcher
|
2024-11-15 16:36:32 +02:00 |
|
|
Karim shoair
|
2abb70218f
|
Adding the proxy support to browser-based Fetchers
|
2024-11-15 14:43:03 +02:00 |
|
|
Karim shoair
|
b993adb4a7
|
Rephrasing some parts
|
2024-11-15 11:26:41 +02:00 |
|
|
Karim shoair
|
ae7959b4a4
|
Update README.md
|
2024-11-15 02:50:24 +02:00 |
|
|
Karim shoair
|
7dd9d3090d
|
Pumping the version up to 0.2.1
|
2024-11-15 02:43:29 +02:00 |
|
|
Karim shoair
|
c334755377
|
Reflecting the new changes in the README and adding small notes
|
2024-11-15 02:33:47 +02:00 |
|
|
Karim shoair
|
095d50cd75
|
Making the Response returned from all fetchers same as Adaptor object
but with added attributes
|
2024-11-15 02:23:14 +02:00 |
|
|
Karim shoair
|
b0c2b1818b
|
Return to the default text behaviour
The logic to remove comment tags before returning text was causing errors sometimes so from now on leave `keep_comments` set to True better as it is.
|
2024-11-14 22:21:45 +02:00 |
|