使用selenium包打开python的tor浏览器
使用selenium包打开python的tor浏览器
提问于 2022-03-09 15:37:55
我正在尝试从tor浏览器中抓取网站。我是用这个代码做的：
import webbrowser
url = 'http://www.google.com/'
webbrowser.register('firefox', None, webbrowser.BackgroundBrowser(r"C:\Users\Lenovo\Bureau\Tor Browser\Browser\firefox.exe"))
webbrowser.get('firefox').open(url)但实际上，当涉及到web抓取时，我更熟悉selenium库。我尝试使用此代码，但引发了WebDriverException错误。
from selenium import webdriver
from selenium.webdriver.firefox.firefox_binary import FirefoxBinary
binary = FirefoxBinary("C:/Users/Lenovo/Bureau/Tor Browser/Browser/firefox.exe")
driver = webdriver.Firefox(firefox_binary = binary)
url = 'https://www.google.com/'
driver.get(url)我想知道是什么导致了这一错误，以及如何解决它。
下面是我遇到的全部错误：
WebDriverException Traceback (most recent call last)
~\AppData\Local\Temp/ipykernel_17288/4279882525.py in <module>
1 url = 'https://www.google.com/'
----> 2 driver.get(url)
~\anaconda3\envs\aa\lib\site-packages\selenium\webdriver\remote\webdriver.py in get(self, url)
434 Loads a web page in the current browser session.
435 """
--> 436 self.execute(Command.GET, {'url': url})
437
438 @property
~\anaconda3\envs\aa\lib\site-packages\selenium\webdriver\remote\webdriver.py in execute(self, driver_command, params)
422 response = self.command_executor.execute(driver_command, params)
423 if response:
--> 424 self.error_handler.check_response(response)
425 response['value'] = self._unwrap_value(
426 response.get('value', None))
~\anaconda3\envs\aa\lib\site-packages\selenium\webdriver\remote\errorhandler.py in check_response(self, response)
245 alert_text = value['alert'].get('text')
246 raise exception_class(message, screen, stacktrace, alert_text) # type: ignore[call-arg] # mypy is not smart enough here
--> 247 raise exception_class(message, screen, stacktrace)
248
249 def _value_or_default(self, obj: Mapping[_KT, _VT], key: _KT, default: _VT) -> _VT:
WebDriverException: Message: Reached error page: about:neterror?e=proxyConnectFailure&u=https%3A//www.google.com/&c=UTF-8&d=Firefox%20is%20configured%20to%20use%20a%20proxy%20server%20that%20is%20refusing%20connections.
Stacktrace:
WebDriverError@chrome://remote/content/shared/webdriver/Errors.jsm:181:5
UnknownError@chrome://remote/content/shared/webdriver/Errors.jsm:488:5
checkReadyState@chrome://remote/content/marionette/navigate.js:64:24
onNavigation@chrome://remote/content/marionette/navigate.js:312:39
emit@resource://gre/modules/EventEmitter.jsm:160:20
receiveMessage@chrome://remote/content/marionette/actors/MarionetteEventsParent.jsm:42:25回答 1
Stack Overflow用户
发布于 2022-03-09 17:46:23
你没有显示错误信息，所以我不知道你有什么问题。
当我尝试在Linux上使用tor时，它会打开tor，而不会出现错误。
(只对"firefox_binary has been deprecated"发出警告，但这不是问题)
但后来它没有加载页面-- get(url) --也没有显示错误。
也许tor是安全的浏览器，因为它阻止了Selenium需要控制浏览器的一些功能。
但是，如果运行tor network，则可以将其作为proxy server与普通Firefox一起使用。
如果页面http://127.0.0.1:9050显示"This is a SOCKs proxy, not an HTTP proxy."
然后tor network正在运行，您可以：
from selenium import webdriver
from selenium.webdriver.firefox.options import Options
from selenium.webdriver.common.proxy import Proxy, ProxyType
proxy = Proxy({
'proxyType': ProxyType.MANUAL,
'socksProxy': '127.0.0.1:9050',
'socksVersion': 5,
})
options = Options()
options.proxy = proxy
#options.binary_location = '/home/furas/bin/tor' # doesn't work
#options.binary_location = '/path/to/normal/firefox' # works
driver = webdriver.Firefox(options=options) # use path to standard `Firefox`
url = 'https://www.google.com/'
url = 'https://icanhazip.com' # it shows your IP
#url = 'https://httpbin.org/get' # it shows your IP and headers/cookies
driver.get(url)PS。有时，tor可能使用端口9150而不是9050。
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/71411975
复制相关文章
相似问题
腾讯云开发者
