Commit Graph

209 Commits

Author SHA1 Message Date
Karim shoair a8c576ad28 Adding the real_chrome option to the fetcher 2024-11-24 15:15:08 +02:00
Karim shoair e96e7d4440 Adding the option to use real chrome browser directly 2024-11-24 15:14:42 +02:00
Karim shoair 088117441d Making the type hints more accurate before update 2024-11-24 13:49:31 +02:00
Karim shoair 15b7e3acee Stop using generated headers by browserforge
It turns out its headers format is pretty outdated, which made Google reCaptcha not work sometimes
2024-11-24 13:47:21 +02:00
Karim shoair 7f330efc52 Turn-off the hide_canvas option by default 2024-11-24 13:44:16 +02:00
Karim shoair 58151c12e8 Update the minimum browser version for headers generated 2024-11-24 13:41:06 +02:00
Karim shoair e94c5034e3 Merge pull request #15 from D4Vinci/docs
Doc adjustments to use Sphinx soon
2024-11-23 17:52:12 +02:00
Karim shoair 1929d9bebb Fix for docs 2024-11-23 17:48:05 +02:00
Karim shoair e51556f80c Merge branch 'main' into docs 2024-11-23 16:48:22 +02:00
Karim shoair 4cea8c9926 Merge pull request #14 from D4Vinci/dev
v0.2.5
2024-11-23 16:39:26 +02:00
Karim shoair 0e01c1cc03 Update test_general.py 2024-11-23 16:24:25 +02:00
Karim shoair 34b645c9a5 Fix for playwright tests on GitHub actions 2024-11-23 16:19:50 +02:00
Karim shoair e7f2a83e16 Increasing the time a little bit for the performance test
It's prolonged on GitHub Actions for obvious reasons
2024-11-23 16:12:00 +02:00
Karim shoair 2b925b4a33 Pumping version up to 0.2.5 2024-11-23 16:06:11 +02:00
Karim shoair 454b79e00f Make tests run in parallel on GitHub actions 2024-11-23 16:04:47 +02:00
Karim shoair 723a545061 Fixing the "Unknown Status Code" test 2024-11-23 16:01:51 +02:00
Karim shoair 7017823136 Covering more parts in Playwright tests 2024-11-23 15:57:59 +02:00
Karim shoair 4d9a494e35 Covering more parts in StealthyFetcher tests 2024-11-23 15:55:50 +02:00
Karim shoair f33ff247dd Adding tests for response encoding and response status text 2024-11-23 15:55:21 +02:00
Karim shoair 073ab2c7e3 Universally handling different response encoding and charsets for all responses
Thanks for @andyfcx
2024-11-23 15:40:41 +02:00
Karim shoair 869412761a Fix for the wait_selector argument resolving to more than 1 element 2024-11-22 22:15:52 +02:00
Karim shoair 18eb96adb1 Merge pull request #13 from andyfcx/main
fix: make sure to default utf-8 as encoding and strip unwanted single or double quotes
2024-11-21 11:21:45 +02:00
andyfcx 63112bfc50 fix: make sure to default utf-8 as encoding and strip unwanted single or double quotes 2024-11-21 14:54:38 +08:00
Karim shoair 3f39bd52d4 Merge branch 'main' into docs 2024-11-20 14:36:30 +02:00
Karim shoair e9b0102d55 Merge pull request #11 from D4Vinci/dev
v0.2.4
2024-11-20 13:35:06 +02:00
Karim shoair 17d7934484 Pump version to 0.2.4 2024-11-20 13:27:39 +02:00
Karim shoair 19ad82caef Calculate status text manually if it's not returned by PlayWright API 2024-11-20 13:27:18 +02:00
Karim shoair 4c74d9bc97 Fixing a bug with reading response bytes in playwright/camoufox when network_idle is used
PlayWright doesn't provide a way to get the response in bytes after all wait ends like `page.content()` so that's more efficient to do anyway
2024-11-20 12:33:54 +02:00
Karim shoair 14738030e0 Merge pull request #10 from D4Vinci/dev
v0.2.3
2024-11-20 01:48:17 +02:00
Karim shoair 649f4cfae7 Pumping up camoufox version 2024-11-20 01:41:46 +02:00
Karim shoair 526c516693 Pump version up to 0.2.3 2024-11-20 01:28:01 +02:00
Karim shoair cb3ab4a011 Merge branch 'main' into dev 2024-11-19 20:48:05 +02:00
Karim shoair b69cc7c983 Fix for the stealth mode on playwright fetcher
The JS files weren't being moved while installing with PIP!
2024-11-19 14:35:24 +02:00
Karim shoair f443d774c1 Fixing the doc-string to match Sphinx 2024-11-19 14:33:54 +02:00
Karim shoair 50cd40cc42 Merge pull request #9 from D4Vinci/dev
v0.2.2
2024-11-16 22:04:03 +02:00
Karim shoair 0c6e7708d1 Update README.md 2024-11-16 21:55:53 +02:00
Karim shoair d8a8af8d05 Updating the README to reflect new changes 2024-11-16 21:29:05 +02:00
Karim shoair b60ac7f56a Change debug mode to be off by default 2024-11-16 21:11:58 +02:00
Karim shoair 422c135aae Adding a file import initialized fetchers for cleaner looking code
and lazy people like me :)
2024-11-16 21:10:26 +02:00
Karim shoair cefc95cc3d Pump version up to 0.2.2 2024-11-16 13:57:33 +02:00
Karim shoair 572df6b3b4 Fixing the way Response object handles sub items in some edge cases
+ Do it with the least impact on performance
2024-11-16 13:54:55 +02:00
Karim shoair 105ec5b067 Update README.md 2024-11-15 23:18:02 +02:00
Karim shoair e2a64a0707 Adding SerpApi as a sponsor 2024-11-15 23:07:59 +02:00
Karim shoair 773fcd59bf Merge pull request #8 from D4Vinci/dev
v0.2.1
2024-11-15 18:25:14 +02:00
Karim shoair 90e38af552 Correcting the return string for the Response object in all functions/methods 2024-11-15 16:44:47 +02:00
Karim shoair 5e8275c3eb Adding the option to randomize the OS fingerprints with the StealthyFetcher 2024-11-15 16:36:32 +02:00
Karim shoair 2abb70218f Adding the proxy support to browser-based Fetchers 2024-11-15 14:43:03 +02:00
Karim shoair b993adb4a7 Rephrasing some parts 2024-11-15 11:26:41 +02:00
Karim shoair ae7959b4a4 Update README.md 2024-11-15 02:50:24 +02:00
Karim shoair 7dd9d3090d Pumping the version up to 0.2.1 2024-11-15 02:43:29 +02:00