freedak/Scrapling
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 1dd04f8250 Update tests.yml Karim shoair 2024-11-05 02:39:15 +02:00
  • 6f7d925a2a Revert "Update tests.yml" Karim shoair 2024-11-05 02:34:43 +02:00
  • 33f44587e6 Update tests.yml Karim shoair 2024-11-05 02:33:21 +02:00
  • 80cc0b77f3 Update tests.yml Karim shoair 2024-11-05 02:31:34 +02:00
  • 4121fe73c9 Update tests.yml Karim shoair 2024-11-05 02:27:30 +02:00
  • 72b36d6a26 Fix werkzeug issue and try caching Karim shoair 2024-11-05 02:22:21 +02:00
  • a5ffc0be5d Update tests.yml Karim shoair 2024-11-05 02:09:32 +02:00
  • 7fd50a4b94 Update tests.yml Karim shoair 2024-11-05 02:06:45 +02:00
  • 3b25a248fc Fixing tests action Karim shoair 2024-11-05 02:04:49 +02:00
  • e594bba0c4 Testing some of the new tests on Github action Karim shoair 2024-11-05 01:19:50 +02:00
  • bd612bb0e2 Updating the disable_resources doc-string Karim shoair 2024-11-04 20:16:04 +02:00
  • 544d23b696 Toolbelt fingerprint functions - Doc strings and type annotations stuff Karim shoair 2024-11-03 23:31:09 +02:00
  • e270b00811 Toolbelt subpackage custom functions general adjustments Karim shoair 2024-11-03 23:17:20 +02:00
  • 2ff0fbb0e5 Engines utils - Navigation functions Karim shoair 2024-11-03 22:46:40 +02:00
  • b8afb390ae Renaming fetcher file to fetchers for clarity Karim shoair 2024-11-03 22:43:16 +02:00
  • 282b130864 Static Engine - Doc strings and type annotations stuff Karim shoair 2024-11-03 22:25:34 +02:00
  • 3af174526f PlayWright Engine - Doc strings and type annotations stuff Karim shoair 2024-11-03 22:24:44 +02:00
  • 54cacb8a4e Camoufox Engine - Doc strings and type annotations stuff Karim shoair 2024-11-03 22:20:29 +02:00
  • 61fd592a6a Adding documentation to PlaywrightFetcher class Karim shoair 2024-11-03 21:04:11 +02:00
  • c1575b8e2e Updating doc-strings for more clarity Karim shoair 2024-11-03 16:49:33 +02:00
  • 1d2c68125a Update fetcher.py Karim shoair 2024-11-03 16:40:42 +02:00
  • 3556d11fb2 StealthyFetcher - Add disable_resources option and its explanation Karim shoair 2024-11-03 16:33:08 +02:00
  • 711de81106 PlaywrightFetcher - The option to drop unnecessary resources requests for speed boost Karim shoair 2024-11-03 16:27:55 +02:00
  • b32e1203f2 StealthyFetcher - The option to drop unnecessary resources requests for speed boost Karim shoair 2024-11-03 16:27:32 +02:00
  • c8c494e73f Adding a function to intercept and drop unwanted requests Karim shoair 2024-11-03 16:25:55 +02:00
  • 0867d9e78a Update README.md Karim shoair 2024-11-03 14:48:33 +02:00
  • e7e499d64b Add documentation for StealthyFetcher class + add webgl option Karim shoair 2024-11-03 14:45:20 +02:00
  • e7300ecba0 StealthFetcher - Add the option to allow webgl in the browser Karim shoair 2024-11-03 14:40:19 +02:00
  • 2528d4e023 Add documentation for the Fetcher class Karim shoair 2024-11-03 14:39:24 +02:00
  • be350f21dd Adding documentation to the base fetcher... Karim shoair 2024-11-03 13:45:13 +02:00
  • 55ab1d63b7 Turn auto_match off when not needed in testing Karim shoair 2024-11-03 13:37:27 +02:00
  • eaae5908c9 Make auto_match enabled by default Karim shoair 2024-11-03 13:33:24 +02:00
  • a0022f7322 Pumping up camoufox version Karim shoair 2024-11-03 13:20:00 +02:00
  • 1ff1c93bcf Give response's body bytes priority over response's text Karim shoair 2024-11-03 13:04:02 +02:00
  • afe53332b8 Convert the request headers to dictionary to unify response object shape across engines Karim shoair 2024-11-03 13:01:48 +02:00
  • 942aa08c85 Handling JSON responses better Karim shoair 2024-11-03 13:00:23 +02:00
  • d845cae816 Update CONTRIBUTING.md Karim shoair 2024-11-03 12:42:53 +02:00
  • 263236a302 Update README.md Karim shoair 2024-11-03 12:42:26 +02:00
  • 26265327b5 Adding the option to update browserforge with camoufox Karim shoair 2024-11-03 12:24:52 +02:00
  • 145c03daff Big structure changes (check commit description) Karim shoair 2024-11-03 01:04:02 +02:00
  • 7f1c06e7bf Pumping camoufox version up Karim shoair 2024-11-02 21:19:13 +02:00
  • 78c718c1d2 I don't know how that happened! Karim shoair 2024-11-02 21:17:56 +02:00
  • 088334b40b Reflecting the new changes in the ReadMe for testers Karim shoair 2024-10-31 02:16:09 +03:00
  • be2847ffb8 Bumping the library for version 0.2 for now and more adjustments Karim shoair 2024-10-31 02:14:41 +03:00
  • 3cb1696d6c Adding the main fetcher file to use for fetching pages Karim shoair 2024-10-31 02:13:35 +03:00
  • aadae4a25b Adding the JavaScript bypasses files for stealth mode Karim shoair 2024-10-31 02:12:37 +03:00
  • 8f8d08b568 Adding browsing engines Karim shoair 2024-10-31 02:11:33 +03:00
  • 6eeca3daa7 Going back to single utils file and using the new types file Karim shoair 2024-10-31 01:32:53 +03:00
  • 23c4181ff2 Using the new types file Karim shoair 2024-10-31 01:32:18 +03:00
  • 1ca2b6cfe4 Combing type definitions in one file Karim shoair 2024-10-31 01:31:10 +03:00
  • e485d51b43 Update ROADMAP.md Karim shoair 2024-10-31 01:16:38 +03:00
  • 427f43eb96 Update MANIFEST.in Karim shoair 2024-10-31 01:15:41 +03:00
  • 327281c664 Making structure clearer to help with the next version Karim shoair 2024-10-26 21:32:57 +03:00
  • 878fe0d373 Update CONTRIBUTING.md Karim shoair 2024-10-26 21:31:57 +03:00
  • 7515f803bc Be more specific about tests Karim shoair 2024-10-26 21:31:31 +03:00
  • 231aeb0616 Dropping Python 3.7 from the tests for next version Karim shoair 2024-10-26 21:30:44 +03:00
  • b45cb4146b Making documentations/templates URLs complete instead of relative Karim shoair 2024-10-16 21:32:47 +03:00
  • 4ca41c9dd8 Small adjustment to stackoverflow example Karim shoair 2024-10-16 19:32:37 +03:00
  • d546b3499b Handling an edge case and adding more commentary Karim shoair 2024-10-16 19:32:01 +03:00
  • a01cfe66db Version 0.1.2 Karim shoair 2024-10-16 18:21:56 +03:00
  • f0a21f6f38 Minor fixes Karim shoair 2024-10-14 03:19:27 +03:00
  • 327e7189bc fix Karim shoair 2024-10-14 03:04:49 +03:00
  • 3b27502797 Update README.md Karim shoair 2024-10-14 03:01:26 +03:00
  • 8b6313221f Update publish.yml Karim shoair 2024-10-14 02:59:15 +03:00
  • 2863511f1f Add one more trigger to the publish workflow Karim shoair 2024-10-14 02:56:20 +03:00
  • 521b27d231 Update setup.py Karim shoair 2024-10-14 02:53:21 +03:00
  • 039755833e Create CODE_OF_CONDUCT.md Karim shoair 2024-10-14 02:23:47 +03:00
  • c63e8baa80 Update bug report template Karim shoair 2024-10-14 02:17:40 +03:00
  • 8d03f8a709 Update README.md Karim shoair 2024-10-14 01:23:46 +03:00
  • 86e2adb84e Fix for the publish workflow Karim shoair 2024-10-14 00:57:39 +03:00
  • b7ab7f31e7 Removing support of Python 3.6 Karim shoair 2024-10-14 00:45:09 +03:00
  • 5569ee9a39 Compatibility fix for Python 3.6 Karim shoair 2024-10-14 00:40:10 +03:00
  • c89fc88f5e Another Compatibility fix for Python 3.7 because I deserve Karim shoair 2024-10-14 00:37:15 +03:00
  • 227d52a86b Compatibility fix for Python 3.7 Karim shoair 2024-10-14 00:35:15 +03:00
  • 223adfdfdc Used the version of Ubuntu that still have Python 3.6 Karim shoair 2024-10-14 00:31:46 +03:00
  • c85fabb581 Handle importing Protocol in Python 3.6 and 3.7 Karim shoair 2024-10-14 00:19:49 +03:00
  • bb36558130 Setting the suitable version for Github again! Karim shoair 2024-10-14 00:19:31 +03:00
  • 84b0ea6121 Handle importing SupportsIndex in Python 3.6 and 3.7 Karim shoair 2024-10-14 00:04:36 +03:00
  • d7f8479991 Fixing test workflow Karim shoair 2024-10-14 00:03:30 +03:00
  • a721073b7c Going online (first public version) Karim shoair 2024-10-13 23:38:48 +03:00
  • ab0e2779f9 Initial commit Karim shoair 2024-10-13 23:29:53 +03:00