Commit Graph

454 Commits

Author SHA1 Message Date
Karim shoair 70b54241e4 Update tox.ini 2024-12-10 23:32:54 +02:00
Karim shoair ba11c433ff Preparing to release 0.2.9 soon 2024-12-10 22:56:51 +02:00
Karim shoair e60a57c63f Python 3.8 is not supported anymore
It's not supported in the new version of Playwright and is problematic in some situations while being slower than newer versions.
2024-12-10 22:37:37 +02:00
Karim shoair 93ed768312 Bumping up the libraries versions for better stealth and speed! 2024-12-10 22:22:34 +02:00
Karim shoair b4f90615c3 Adding keep_cdata argument for Adaptor and Response classes
This will force lxml to keep cdata while parsing html if you want
2024-12-10 22:06:08 +02:00
Karim shoair 5f9c3980dc Adding urljoin method to Adaptors and Responses 2024-12-10 22:02:43 +02:00
Karim shoair d0f18951ac fix: Enable WebGL by default 2024-12-04 23:38:30 +02:00
Karim shoair 45e86f50a3 Adding empty methods (get/get_all/extract/extract_all)
For easy copy-paste from Scrapy/parsel code when needed :)
2024-12-04 14:28:37 +02:00
Karim shoair 31e838ce9b Make standard string methods return TextHandler again instead of str 2024-12-04 14:27:36 +02:00
Karim shoair 012820c635 Merge pull request #21 from D4Vinci/dev
v0.2.8
2024-11-30 18:16:06 +02:00
Karim shoair c481a1c8ad Pumping version up to 0.2.8 2024-11-30 18:13:19 +02:00
Karim shoair a3a4f1ff19 A cleanup script to use with development 2024-11-30 18:01:35 +02:00
Karim shoair f7916e504e Update tox.ini 2024-11-30 14:32:42 +02:00
Karim shoair 8321cfc180 Add vermin hook to check for minimum python version 2024-11-30 14:28:10 +02:00
Karim shoair b38c38b03b Forcing Tox to always use pytest config file 2024-11-30 14:14:59 +02:00
Karim shoair f81e3b3cc3 Turn off threaded testing for Python 3.8 on tox
part 2 :)
2024-11-30 14:08:18 +02:00
Karim shoair 1a17b2ce46 Sorting all library imports with isort 2024-11-30 14:02:06 +02:00
Karim shoair 26bfa88e50 Turn off threaded testing for Python 3.8 on tox 2024-11-30 14:01:30 +02:00
Karim shoair 4dddebbe24 Update .bandit.yml 2024-11-30 13:47:46 +02:00
Karim shoair 7608d86bf2 Pumping up camoufox version 2024-11-30 11:24:47 +02:00
Karim shoair 82f8e4a073 Fixing import typo, thanks to #20 2024-11-30 11:23:07 +02:00
Karim shoair 1cf7a1d205 Make Github tests workflow work on main and dev branches only
The docs branch doesn't need tests
2024-11-29 21:19:39 +02:00
Karim shoair 97fecc9d5f Style adjustments by flake8 2024-11-29 21:14:52 +02:00
Karim shoair d6cc07deaa Add scrapless banner 2024-11-29 11:26:48 +02:00
Karim shoair f8ad18ab8a Rephrasing some parts to be clearer 2024-11-27 11:50:20 +02:00
Karim shoair 26aebbace2 Merge pull request #18 from D4Vinci/dev
v0.2.7
2024-11-26 23:10:49 +02:00
Karim shoair 06a47f9644 Small fix for the ResponseEncoding class 2024-11-26 22:55:22 +02:00
Karim shoair 28b783e86b Improving the stealth mode a bit for Playwright 2024-11-26 22:41:04 +02:00
Karim shoair 14ffdbd6fc Handling problematic encodings 2024-11-26 22:27:05 +02:00
Karim shoair d3fbcab3df Pumping version up to 0.2.7 2024-11-26 21:27:22 +02:00
Karim shoair ccf38606d8 Making the README clearer a bit 2024-11-26 21:25:16 +02:00
Karim shoair dbd674aa7c Adding proxy support for basic requests 2024-11-26 21:24:41 +02:00
Karim shoair 1cf7cee1a2 Fetchers - Wait for page to be stable again if the user wanted to wait for a selector 2024-11-26 20:26:54 +02:00
Karim shoair d6a59774ea StealthyFetcher - The option to disable ads with ublock origin addon 2024-11-26 20:23:02 +02:00
Karim shoair 60d551d839 PlaywrightFetcher - Add the option to set locale of the browser 2024-11-26 17:39:03 +02:00
Karim shoair 0176bc0523 PlaywrightFetcher - Make proxies available without enabling stealth
Thanks for @AbdullahY36
2024-11-26 16:48:35 +02:00
Karim shoair 468d9b8f63 Update README.md 2024-11-25 12:28:06 +02:00
Karim shoair 1ab0f74cce Updating SerpApi Logo 2024-11-25 12:26:19 +02:00
Karim shoair 109933c04a Merge pull request #17 from D4Vinci/dev
Update SerpApi.png
2024-11-25 11:47:38 +02:00
Karim shoair b3817c5b3a Update SerpApi.png 2024-11-25 11:46:13 +02:00
Karim shoair cdc7ed8fa8 Removing CapSolver 2024-11-25 11:26:42 +02:00
Karim shoair bbbc97aef9 Merge pull request #16 from D4Vinci/dev
v0.2.6
2024-11-24 15:36:28 +02:00
Karim shoair 438867e0be Pumping the version up to 0.2.6 2024-11-24 15:21:58 +02:00
Karim shoair 12d638ac2e Updating the doc to reflect new changes 2024-11-24 15:20:18 +02:00
Karim shoair c1429074a7 Setting the compatible version of playwright with cdp patches 2024-11-24 15:15:58 +02:00
Karim shoair a8c576ad28 Adding the real_chrome option to the fetcher 2024-11-24 15:15:08 +02:00
Karim shoair e96e7d4440 Adding the option to use real chrome browser directly 2024-11-24 15:14:42 +02:00
Karim shoair 088117441d Making the type hints more accurate before update 2024-11-24 13:49:31 +02:00
Karim shoair 15b7e3acee Stop using generated headers by browserforge
It turns out its headers format is pretty outdated, which made Google reCaptcha not work sometimes
2024-11-24 13:47:21 +02:00
Karim shoair 7f330efc52 Turn-off the hide_canvas option by default 2024-11-24 13:44:16 +02:00