freedak/Scrapling
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Stop using generated headers by browserforge

Browse Source 
It turns out its headers format is pretty outdated, which made Google reCaptcha not work sometimes
This commit is contained in:
Karim shoair
2024-11-24 13:47:21 +02:00
parent 7f330efc52
commit 15b7e3acee
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scrapling/engines/pw.py
+2 -2
View File
@@ -130,8 +130,8 @@ class PlaywrightEngine:
extra_headers = {} extra_headers = {}
useragent = self.useragent useragent = self.useragent
else: else:
extra_headers = generate_headers(browser_mode=True) extra_headers = {}
useragent = extra_headers.get('User-Agent') useragent = generate_headers(browser_mode=True).get('User-Agent')
# Prepare the flags before diving # Prepare the flags before diving
flags = DEFAULT_STEALTH_FLAGS flags = DEFAULT_STEALTH_FLAGS