blocks|key|2923200|text|proxies的dict语法是{"protocol":"ip:port",+...}。通过它，您可以使用http、https和ftp协议为请求指定不同的(或相同的)代理：|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|2923201|http_proxy++=+"http://10.10.1.10:3128"
https_proxy+=+"https://10.10.1.11:1080"
ftp_proxy+++=+"ftp://10.10.1.10:3128"

proxyDict+=+{+
++++++++++++++"http"++:+http_proxy,+
++++++++++++++"https"+:+https_proxy,+
++++++++++++++"ftp"+++:+ftp_proxy
++++++++++++}

r+=+requests.get(url,+headers=headers,+proxies=proxyDict)|code-block|syntax|javascript|2923202|从requests+documentation推导而来|2923203|2923204|+参数：|blockquote|BOLD|2923205|2923206|method+-新请求对象的方法。|2923207|URL+-新请求对象的url。|2923208|..。|2923209|proxies+-(可选)将协议映射到代理的URL的字典。|2923210|...+|2923211|2923212|在linux上，您还可以通过HTTP_PROXY、HTTPS_PROXY和FTP_PROXY环境变量执行此操作：|2923213|export+HTTP_PROXY=10.10.1.10:3128
export+HTTPS_PROXY=10.10.1.11:1080
export+FTP_PROXY=10.10.1.10:3128|2923214|在Windows上：|2923215|set+http_proxy=10.10.1.10:3128
set+https_proxy=10.10.1.11:1080
set+ftp_proxy=10.10.1.10:3128|2923216|2923217|谢谢，Jay指出这一点：|2923218|语法在requests+2.0.0中发生了变化。|2923219|您需要将一个模式添加到url：https://2.python-requests.org/en/latest/user/advanced/#proxies|2923220|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.python-requests.org/en/latest/api/#module-requests|1|https://2.python-requests.org/en/latest/user/advanced/#proxies^0|0|7|F|R|0|0|1|8|1|M|0|0|0|1|3|0|0|0|6|0|B|3|0|0|0|7|E|2|L|1|0|0|0|E|A|P|B|11|9|0|0|0|0|0|0|3|E|0|F|1Q|1|0^^$0|@$1|2|3|4|5|6|7|1S|8|@$9|1T|A|1U|B|C]|$9|1V|A|1W|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|1X|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|1Y|8|@$9|1Z|A|20|B|C]]|D|@$9|21|A|22|1|23]]|E|$]]|$1|M|3|-4|5|6|7|24|8|@]|D|@]|E|$]]|$1|N|3|O|5|P|7|25|8|@$9|26|A|27|B|Q]]|D|@]|E|$]]|$1|R|3|-4|5|6|7|28|8|@]|D|@]|E|$]]|$1|S|3|T|5|6|7|29|8|@$9|2A|A|2B|B|C]]|D|@]|E|$]]|$1|U|3|V|5|6|7|2C|8|@$9|2D|A|2E|B|C]]|D|@]|E|$]]|$1|W|3|X|5|6|7|2F|8|@]|D|@]|E|$]]|$1|Y|3|Z|5|6|7|2G|8|@$9|2H|A|2I|B|C]|$9|2J|A|2K|B|Q]|$9|2L|A|2M|B|Q]]|D|@]|E|$]]|$1|10|3|11|5|6|7|2N|8|@]|D|@]|E|$]]|$1|12|3|-4|5|6|7|2O|8|@]|D|@]|E|$]]|$1|13|3|14|5|6|7|2P|8|@$9|2Q|A|2R|B|C]|$9|2S|A|2T|B|C]|$9|2U|A|2V|B|C]]|D|@]|E|$]]|$1|15|3|16|5|H|7|2W|8|@]|D|@]|E|$I|J]]|$1|17|3|18|5|6|7|2X|8|@]|D|@]|E|$]]|$1|19|3|1A|5|H|7|2Y|8|@]|D|@]|E|$I|J]]|$1|1B|3|-4|5|6|7|2Z|8|@]|D|@]|E|$]]|$1|1C|3|1D|5|6|7|30|8|@]|D|@]|E|$]]|$1|1E|3|1F|5|6|7|31|8|@$9|32|A|33|B|Q]]|D|@]|E|$]]|$1|1G|3|1H|5|6|7|34|8|@]|D|@$9|35|A|36|1|37]]|E|$]]|$1|1I|3|-4|5|6|7|38|8|@]|D|@]|E|$]]]|1J|$1K|$5|1L|1M|1N|E|$1O|1P]]|1Q|$5|1L|1M|1N|E|$1O|1R]]]]

The <code>proxies</code>' dict syntax is <code>{"protocol":"ip:port", ...}</code>. With it you can specify different (or the same) proxie(s) for requests using http, https, and ftp protocols:

<pre><code>http_proxy = "http://10.10.1.10:3128"
https_proxy = "https://10.10.1.11:1080"
ftp_proxy = "ftp://10.10.1.10:3128"

proxyDict = { 
 "http" : http_proxy, 
 "https" : https_proxy, 
 "ftp" : ftp_proxy
 }

r = requests.get(url, headers=headers, proxies=proxyDict)
</code></pre>

Deduced from the <a href="http://docs.python-requests.org/en/latest/api/#module-requests" rel="noreferrer"><code>requests</code> documentation</a>:

<blockquote>
 Parameters: 
 <code>method</code> – method for the new Request object. 
 <code>url</code> – URL for the new Request object. 
 ... 
 <code>proxies</code> – (optional) Dictionary mapping protocol to the URL of the proxy. 
 ... 
</blockquote>

<hr>

On linux you can also do this via the <code>HTTP_PROXY</code>, <code>HTTPS_PROXY</code>, and <code>FTP_PROXY</code> environment variables:

<pre><code>export HTTP_PROXY=10.10.1.10:3128
export HTTPS_PROXY=10.10.1.11:1080
export FTP_PROXY=10.10.1.10:3128
</code></pre>

On Windows:

<pre><code>set http_proxy=10.10.1.10:3128
set https_proxy=10.10.1.11:1080
set ftp_proxy=10.10.1.10:3128
</code></pre>

<hr>

Thanks, Jay for pointing this out: 
The syntax changed with requests 2.0.0. 
You'll need to add a schema to the url: <a href="https://2.python-requests.org/en/latest/user/advanced/#proxies" rel="noreferrer">https://2.python-requests.org/en/latest/user/advanced/#proxies</a>

blocks|key|3137264|text|这是我用python编写的request模块的基本类，带有一些代理配置和秒表！|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3137265|import+requests
import+time
class+BaseCheck():
++++def+__init__(self,+url):
++++++++self.http_proxy++=+"http://user:pw@proxy:8080"
++++++++self.https_proxy+=+"http://user:pw@proxy:8080"
++++++++self.ftp_proxy+++=+"http://user:pw@proxy:8080"
++++++++self.proxyDict+=+{
++++++++++++++++++++++"http"++:+self.http_proxy,
++++++++++++++++++++++"https"+:+self.https_proxy,
++++++++++++++++++++++"ftp"+++:+self.ftp_proxy
++++++++++++++++++++}
++++++++self.url+=+url
++++++++def+makearr(tsteps):
++++++++++++global+stemps
++++++++++++global+steps
++++++++++++stemps+=+{}
++++++++++++for+step+in+tsteps:
++++++++++++++++stemps[step]+=+{+'start':+0,+'end':+0+}
++++++++++++steps+=+tsteps
++++++++makearr(['init','check'])
++++++++def+starttime(typ+=+""):
++++++++++++for+stemp+in+stemps:
++++++++++++++++if+typ+==+"":
++++++++++++++++++++stemps[stemp]['start']+=+time.time()
++++++++++++++++else:
++++++++++++++++++++stemps[stemp][typ]+=+time.time()
++++++++starttime()
++++def+__str__(self):
++++++++return+str(self.url)
++++def+getrequests(self):
++++++++g=requests.get(self.url,proxies=self.proxyDict)
++++++++print+g.status_code
++++++++print+g.content
++++++++print+self.url
++++++++stemps['init']['end']+=+time.time()
++++++++#print+stemps['init']['end']+-+stemps['init']['start']
++++++++x=+stemps['init']['end']+-+stemps['init']['start']
++++++++print+x


test=BaseCheck(url='http://google.com')
test.getrequests()|code-block|syntax|javascript|3137266|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

here is my basic class in python for the requests module with some proxy configs and stopwatch !

<pre><code>import requests
import time
class BaseCheck():
 def __init__(self, url):
 self.http_proxy = "http://user:pw@proxy:8080"
 self.https_proxy = "http://user:pw@proxy:8080"
 self.ftp_proxy = "http://user:pw@proxy:8080"
 self.proxyDict = {
 "http" : self.http_proxy,
 "https" : self.https_proxy,
 "ftp" : self.ftp_proxy
 }
 self.url = url
 def makearr(tsteps):
 global stemps
 global steps
 stemps = {}
 for step in tsteps:
 stemps[step] = { 'start': 0, 'end': 0 }
 steps = tsteps
 makearr(['init','check'])
 def starttime(typ = ""):
 for stemp in stemps:
 if typ == "":
 stemps[stemp]['start'] = time.time()
 else:
 stemps[stemp][typ] = time.time()
 starttime()
 def __str__(self):
 return str(self.url)
 def getrequests(self):
 g=requests.get(self.url,proxies=self.proxyDict)
 print g.status_code
 print g.content
 print self.url
 stemps['init']['end'] = time.time()
 #print stemps['init']['end'] - stemps['init']['start']
 x= stemps['init']['end'] - stemps['init']['start']
 print x


test=BaseCheck(url='http://google.com')
test.getrequests()
</code></pre>

blocks|key|244876|text|您可以参考proxy+documentation+here。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|244877|如果您需要使用代理，您可以使用proxies参数为任何请求方法配置单个请求：|244878|import+requests

proxies+=+{
++"http":+"http://10.10.1.10:3128",
++"https":+"https://10.10.1.10:1080",
}

requests.get("http://example.org",+proxies=proxies)|code-block|syntax|javascript|244879|要对代理使用HTTP+Basic+Auth，请使用http://user:password@host.com/语法：|244880|proxies+=+{
++++"http":+"http://user:pass@10.10.1.10:3128/"
}|244881|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.python-requests.org/en/latest/user/advanced/#proxies|1|http://user:password@host.com/^0|5|O|0|0|0|0|P|U|1|0|0^^$0|@$1|2|3|4|5|6|7|Y|8|@]|9|@$A|Z|B|10|1|11]]|C|$]]|$1|D|3|E|5|6|7|12|8|@]|9|@]|C|$]]|$1|F|3|G|5|H|7|13|8|@]|9|@]|C|$I|J]]|$1|K|3|L|5|6|7|14|8|@]|9|@$A|15|B|16|1|17]]|C|$]]|$1|M|3|N|5|H|7|18|8|@]|9|@]|C|$I|J]]|$1|O|3|-4|5|6|7|19|8|@]|9|@]|C|$]]]|P|$Q|$5|R|S|T|C|$U|V]]|W|$5|R|S|T|C|$U|X]]]]

You can refer to the <a href="http://docs.python-requests.org/en/latest/user/advanced/#proxies" rel="noreferrer">proxy documentation here</a>.

If you need to use a proxy, you can configure individual requests with the proxies argument to any request method:

<pre><code>import requests

proxies = {
 "http": "http://10.10.1.10:3128",
 "https": "https://10.10.1.10:1080",
}

requests.get("http://example.org", proxies=proxies)
</code></pre>

To use HTTP Basic Auth with your proxy, use the <a href="http://user:password@host.com/" rel="noreferrer">http://user:password@host.com/</a> syntax:

<pre><code>proxies = {
 "http": "http://user:pass@10.10.1.10:3128/"
}
</code></pre>

blocks|key|3137322|text|我发现urllib有一些非常好的代码来获取系统的代理设置，而且它们恰好是以正确的形式直接使用的。您可以像这样使用：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3137323|import+urllib

...
r+=+requests.get('http://example.org',+proxies=urllib.request.getproxies())|code-block|syntax|javascript|3137324|它工作得很好，urllib也知道如何获取Mac和Windows设置。|3137325|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

I have found that urllib has some really good code to pick up the system's proxy settings and they happen to be in the correct form to use directly. You can use this like:

<pre><code>import urllib

...
r = requests.get('http://example.org', proxies=urllib.request.getproxies())
</code></pre>

It works really well and urllib knows about getting Mac OS X and Windows settings as well.

blocks|key|2923274|text|对我来说，公认的答案是一个良好的开端，但我一直收到以下错误：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2923275|AssertionError:+Not+supported+proxy+scheme+None|code-block|syntax|javascript|2923276|修复方法是在代理url中指定http://，如下所示：|2923277|http_proxy++=+"http://194.62.145.248:8080"
https_proxy++=+"https://194.62.145.248:8080"
ftp_proxy+++=+"10.10.1.10:3128"

proxyDict+=+{
++++++++++++++"http"++:+http_proxy,
++++++++++++++"https"+:+https_proxy,
++++++++++++++"ftp"+++:+ftp_proxy
++++++++++++}|2923278|我会感兴趣的是，为什么原始版本对某些人有效，而对我无效。|2923279|编辑:我看到主要答案现在已经更新，以反映这一点:)|2923280|entityMap^0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|R|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|S|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|T|8|@]|9|@]|A|$E|F]]|$1|K|3|L|5|6|7|U|8|@]|9|@]|A|$]]|$1|M|3|N|5|6|7|V|8|@]|9|@]|A|$]]|$1|O|3|-4|5|6|7|W|8|@]|9|@]|A|$]]]|P|$]]

The accepted answer was a good start for me, but I kept getting the following error:

<pre><code>AssertionError: Not supported proxy scheme None
</code></pre>

Fix to this was to specify the http:// in the proxy url thus: 

<pre><code>http_proxy = "http://194.62.145.248:8080"
https_proxy = "https://194.62.145.248:8080"
ftp_proxy = "10.10.1.10:3128"

proxyDict = {
 "http" : http_proxy,
 "https" : https_proxy,
 "ftp" : ftp_proxy
 }
</code></pre>

I'd be interested as to why the original works for some people but not me. 

Edit: I see the main answer is now updated to reflect this :)

blocks|key|246918|text|虽然有点晚，但这里有一个包装器类，它简化了抓取代理，然后创建http+POST或GET：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|246919|ProxyRequests|246920|https://github.com/rootVIII/proxy_requests|code-block|syntax|javascript|246921|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|L|8|@]|9|@]|A|$]]|$1|D|3|E|5|F|7|M|8|@]|9|@]|A|$G|H]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

It’s a bit late but here is a wrapper class that simplifies scraping proxies and then making an http POST or GET:

ProxyRequests

<pre><code>https://github.com/rootVIII/proxy_requests
</code></pre>

blocks|key|244924|text|如果你想持久化cookie和会话数据，你最好这样做：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|244925|import+requests

proxies+=+{
++++'http':+'http://user:pass@10.10.1.0:3128',
++++'https':+'https://user:pass@10.10.1.0:3128',
}

#+Create+the+session+and+set+the+proxies.
s+=+requests.Session()
s.proxies+=+proxies

#+Make+the+HTTP+request+through+the+session.
r+=+s.get('http://www.showmemyip.com/')|code-block|syntax|javascript|244926|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

If you'd like to persisist cookies and session data, you'd best do it like this:

<pre><code>import requests

proxies = {
 'http': 'http://user:pass@10.10.1.0:3128',
 'https': 'https://user:pass@10.10.1.0:3128',
}

# Create the session and set the proxies.
s = requests.Session()
s.proxies = proxies

# Make the HTTP request through the session.
r = s.get('http://www.showmemyip.com/')
</code></pre>

blocks|key|3137378|text|我刚刚做了一个代理graber，也可以连接到同一个抓取的代理，没有任何输入这里是：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3137379|#Import+Modules

from+termcolor+import+colored
from+selenium+import+webdriver
import+requests
import+os
import+sys
import+time

#Proxy+Grab

options+=+webdriver.ChromeOptions()
options.add_argument('headless')
driver+=+webdriver.Chrome(chrome_options=options)
driver.get("https://www.sslproxies.org/")
tbody+=+driver.find_element_by_tag_name("tbody")
cell+=+tbody.find_elements_by_tag_name("tr")
for+column+in+cell:

++++++++column+=+column.text.split("+")
++++++++print(colored(column[0]%2B":"%2Bcolumn[1],'yellow'))
driver.quit()
print("")

os.system('clear')
os.system('cls')

#Proxy+Connection

print(colored('Getting+Proxies+from+graber...','green'))
time.sleep(2)
os.system('clear')
os.system('cls')
proxy+=+{"http":+"http://"%2B+column[0]%2B":"%2Bcolumn[1]}
url+=+'https://mobile.facebook.com/login'
r+=+requests.get(url,++proxies=proxy)
print("")
print(colored('Connecting+using+proxy'+,'green'))
print("")
sts+=+r.status_code|code-block|syntax|javascript|3137380|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

i just made a proxy graber and also can connect with same grabed proxy without any input 
here is :

<pre><code>#Import Modules

from termcolor import colored
from selenium import webdriver
import requests
import os
import sys
import time

#Proxy Grab

options = webdriver.ChromeOptions()
options.add_argument('headless')
driver = webdriver.Chrome(chrome_options=options)
driver.get("https://www.sslproxies.org/")
tbody = driver.find_element_by_tag_name("tbody")
cell = tbody.find_elements_by_tag_name("tr")
for column in cell:

 column = column.text.split(" ")
 print(colored(column[0]+":"+column[1],'yellow'))
driver.quit()
print("")

os.system('clear')
os.system('cls')

#Proxy Connection

print(colored('Getting Proxies from graber...','green'))
time.sleep(2)
os.system('clear')
os.system('cls')
proxy = {"http": "http://"+ column[0]+":"+column[1]}
url = 'https://mobile.facebook.com/login'
r = requests.get(url, proxies=proxy)
print("")
print(colored('Connecting using proxy' ,'green'))
print("")
sts = r.status_code
</code></pre>

blocks|key|249773|text|晚了8年。但我喜欢：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|249774|import+os
import+requests

os.environ['HTTP_PROXY']+=+os.environ['http_proxy']+=+'http://http-connect-proxy:3128/'
os.environ['HTTPS_PROXY']+=+os.environ['https_proxy']+=+'http://http-connect-proxy:3128/'
os.environ['NO_PROXY']+=+os.environ['no_proxy']+=+'127.0.0.1,localhost,.local'

r+=+requests.get('https://example.com')++#+,+verify=False|code-block|syntax|javascript|249775|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

8 years late. But I like:

<pre><code>import os
import requests

os.environ['HTTP_PROXY'] = os.environ['http_proxy'] = 'http://http-connect-proxy:3128/'
os.environ['HTTPS_PROXY'] = os.environ['https_proxy'] = 'http://http-connect-proxy:3128/'
os.environ['NO_PROXY'] = os.environ['no_proxy'] = '127.0.0.1,localhost,.local'

r = requests.get('https://example.com') # , verify=False
</code></pre>

blocks|key|2923364|text|我分享了一些代码，如何从网站"https://free-proxy-list.net“获取代理，并将数据存储到与”精英代理切换器“(格式为IP:PORT)等工具兼容的文件中：|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|2923365|##PROXY_UPDATER+-从https://free-proxy-list.net/获取免费代理|2923366|from+lxml.html+import+fromstring
import+requests
from+itertools+import+cycle
import+traceback
import+re

######################FIND+PROXIES#########################################
def+get_proxies():
++++url+=+'https://free-proxy-list.net/'
++++response+=+requests.get(url)
++++parser+=+fromstring(response.text)
++++proxies+=+set()
++++for+i+in+parser.xpath('//tbody/tr')[:299]:+++#299+proxies+max
++++++++proxy+=+":".join([i.xpath('.//td[1]/text()')+
++++++++[0],i.xpath('.//td[2]/text()')[0]])
++++++++proxies.add(proxy)
++++return+proxies



######################write+to+file+in+format+++IP:PORT######################
try:
++++proxies+=+get_proxies()
++++f=open('proxy_list.txt','w')
++++for+proxy+in+proxies:
++++++++f.write(proxy%2B'\n')
++++f.close()
++++print+("DONE")
except:
++++print+("MAJOR+ERROR")|code-block|syntax|javascript|2923367|entityMap|0|LINK|mutability|MUTABLE|url|https://free-proxy-list.net/|1^0|F|R|0|0|I|S|1|0|0^^$0|@$1|2|3|4|5|6|7|T|8|@]|9|@$A|U|B|V|1|W]]|C|$]]|$1|D|3|E|5|6|7|X|8|@]|9|@$A|Y|B|Z|1|10]]|C|$]]|$1|F|3|G|5|H|7|11|8|@]|9|@]|C|$I|J]]|$1|K|3|-4|5|6|7|12|8|@]|9|@]|C|$]]]|L|$M|$5|N|O|P|C|$Q|R]]|S|$5|N|O|P|C|$Q|R]]]]

I share some code how to fetch proxies from the site &quot;https://free-proxy-list.net&quot; and store data to a file compatible with tools like &quot;Elite Proxy Switcher&quot;(format IP:PORT):
##PROXY_UPDATER - get free proxies from <a href="https://free-proxy-list.net/" rel="nofollow noreferrer">https://free-proxy-list.net/</a>
<pre><code>from lxml.html import fromstring
import requests
from itertools import cycle
import traceback
import re

######################FIND PROXIES#########################################
def get_proxies():
 url = 'https://free-proxy-list.net/'
 response = requests.get(url)
 parser = fromstring(response.text)
 proxies = set()
 for i in parser.xpath('//tbody/tr')[:299]: #299 proxies max
 proxy = &quot;:&quot;.join([i.xpath('.//td[1]/text()') 
 [0],i.xpath('.//td[2]/text()')[0]])
 proxies.add(proxy)
 return proxies



######################write to file in format IP:PORT######################
try:
 proxies = get_proxies()
 f=open('proxy_list.txt','w')
 for proxy in proxies:
 f.write(proxy+'\n')
 f.close()
 print (&quot;DONE&quot;)
except:
 print (&quot;MAJOR ERROR&quot;)
</code></pre>

blocks|key|249784|text|经过测试，以下代码可以正常工作。需要使用HTTPProxyAuth。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|249785|import+requests
from+requests.auth+import+HTTPProxyAuth


USE_PROXY+=+True
proxy_user+=+"aaa"
proxy_password+=+"bbb"
http_proxy+=+"http://your_proxy_server:8080"
https_proxy+=+"http://your_proxy_server:8080"
proxies+=+{
++++"http":+http_proxy,
++++"https":+https_proxy
}

def+test(name):
++++print(f'Hi,+{name}')++#+Press+Ctrl%2BF8+to+toggle+the+breakpoint.
++++#+Create+the+session+and+set+the+proxies.
++++session+=+requests.Session()
++++if+USE_PROXY:
++++++++session.trust_env+=+False
++++++++session.proxies+=+proxies
++++++++session.auth+=+HTTPProxyAuth(proxy_user,+proxy_password)

++++r+=+session.get('https://www.stackoverflow.com')
++++print(r.status_code)

if+__name__+==+'__main__':
++++test('aaa')|code-block|syntax|javascript|249786|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Already tested, the following code works. Need to use HTTPProxyAuth.
<pre><code>import requests
from requests.auth import HTTPProxyAuth


USE_PROXY = True
proxy_user = &quot;aaa&quot;
proxy_password = &quot;bbb&quot;
http_proxy = &quot;http://your_proxy_server:8080&quot;
https_proxy = &quot;http://your_proxy_server:8080&quot;
proxies = {
 &quot;http&quot;: http_proxy,
 &quot;https&quot;: https_proxy
}

def test(name):
 print(f'Hi, {name}') # Press Ctrl+F8 to toggle the breakpoint.
 # Create the session and set the proxies.
 session = requests.Session()
 if USE_PROXY:
 session.trust_env = False
 session.proxies = proxies
 session.auth = HTTPProxyAuth(proxy_user, proxy_password)

 r = session.get('https://www.stackoverflow.com')
 print(r.status_code)

if __name__ == '__main__':
 test('aaa')
</code></pre>

blocks|key|2923417|text|documentation给出了一个非常清晰的代理用法示例|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|2923418|import+requests

proxies+=+{
++'http':+'http://10.10.1.10:3128',
++'https':+'http://10.10.1.10:1080',
}

requests.get('http://example.org',+proxies=proxies)|code-block|syntax|javascript|2923419|然而，您甚至可以为单独的urls配置代理，即使模式是相同的，这一事实并未记录在案！当你想对你想要抓取的不同网站使用不同的代理时，这会派上用场。|2923420|proxies+=+{
++'http://example.org':+'http://10.10.1.10:3128',
++'http://something.test':+'http://10.10.1.10:1080',
}

requests.get('http://something.test/some/url',+proxies=proxies)|2923421|此外，requests.get本质上是在幕后使用requests.Session，所以如果您需要更多的控制，可以直接使用它|style|CODE|2923422|import+requests

proxies+=+{
++'http':+'http://10.10.1.10:3128',
++'https':+'http://10.10.1.10:1080',
}
session+=+requests.Session()
session.proxies.update(proxies)

session.get('http://example.org')|2923423|我使用它来设置一个回退(一个默认代理)来处理所有与字典中指定的模式/urls不匹配的流量|2923424|import+requests

proxies+=+{
++'http':+'http://10.10.1.10:3128',
++'https':+'http://10.10.1.10:1080',
}
session+=+requests.Session()
session.proxies.setdefault('http',+'http://127.0.0.1:9009')
session.proxies.update(proxies)

session.get('http://example.org')|2923425|entityMap|0|LINK|mutability|MUTABLE|url|https://2.python-requests.org/en/latest/user/advanced/#proxies^0|0|D|0|0|0|0|0|3|C|O|G|0|0|0|0^^$0|@$1|2|3|4|5|6|7|14|8|@]|9|@$A|15|B|16|1|17]]|C|$]]|$1|D|3|E|5|F|7|18|8|@]|9|@]|C|$G|H]]|$1|I|3|J|5|6|7|19|8|@]|9|@]|C|$]]|$1|K|3|L|5|F|7|1A|8|@]|9|@]|C|$G|H]]|$1|M|3|N|5|6|7|1B|8|@$A|1C|B|1D|O|P]|$A|1E|B|1F|O|P]]|9|@]|C|$]]|$1|Q|3|R|5|F|7|1G|8|@]|9|@]|C|$G|H]]|$1|S|3|T|5|6|7|1H|8|@]|9|@]|C|$]]|$1|U|3|V|5|F|7|1I|8|@]|9|@]|C|$G|H]]|$1|W|3|-4|5|6|7|1J|8|@]|9|@]|C|$]]]|X|$Y|$5|Z|10|11|C|$12|13]]]]

The <a href="https://2.python-requests.org/en/latest/user/advanced/#proxies" rel="nofollow noreferrer">documentation</a>
gives a very clear example of the proxies usage
<pre class="lang-py prettyprint-override"><code>import requests

proxies = {
 'http': 'http://10.10.1.10:3128',
 'https': 'http://10.10.1.10:1080',
}

requests.get('http://example.org', proxies=proxies)
</code></pre>
What isn't documented, however, is the fact that you can even configure proxies for individual urls even if the schema is the same!
This comes in handy when you want to use different proxies for different websites you wish to scrape.
<pre class="lang-py prettyprint-override"><code>proxies = {
 'http://example.org': 'http://10.10.1.10:3128',
 'http://something.test': 'http://10.10.1.10:1080',
}

requests.get('http://something.test/some/url', proxies=proxies)
</code></pre>
Additionally, <code>requests.get</code> essentially uses the <code>requests.Session</code> under the hood, so if you need more control, use it directly
<pre class="lang-py prettyprint-override"><code>import requests

proxies = {
 'http': 'http://10.10.1.10:3128',
 'https': 'http://10.10.1.10:1080',
}
session = requests.Session()
session.proxies.update(proxies)

session.get('http://example.org')
</code></pre>
I use it to set a fallback (a default proxy) that handles all traffic that doesn't match the schemas/urls specified in the dictionary
<pre class="lang-py prettyprint-override"><code>import requests

proxies = {
 'http': 'http://10.10.1.10:3128',
 'https': 'http://10.10.1.10:1080',
}
session = requests.Session()
session.proxies.setdefault('http', 'http://127.0.0.1:9009')
session.proxies.update(proxies)

session.get('http://example.org')
</code></pre>

Just a short, simple one about the excellent <a href="http://docs.python-requests.org/en/latest/index.html" rel="noreferrer">Requests</a> module for Python.

I can't seem to find in the documentation what the variable 'proxies' should contain. When I send it a dict with a standard "IP:PORT" value it rejected it asking for 2 values.
So, I guess (because this doesn't seem to be covered in the docs) that the first value is the ip and the second the port? 

The docs mention this only:

<blockquote>
 proxies – (optional) Dictionary mapping protocol to the URL of the proxy.
</blockquote>

So I tried this... what should I be doing? 

<pre><code>proxy = { ip: port}
</code></pre>

and should I convert these to some type before putting them in the dict? 

<pre><code>r = requests.get(url,headers=headers,proxies=proxy)
</code></pre>

Proxies with Python 'Requests' module

数据存储

Windows

Python

这只是一个简短而简单的关于Python的优秀模块的文章。我似乎在文档中找不到变量“proxies”应该包含的内容。当我向它发送一个带有标准"IP:PORT“值的dict时，它拒绝了它，要求提供2个值。因此，我猜测(因为文档中似乎没有涉及这一点)，第一个值是ip，第二个值是端口？文档只提到了这一点：URL (可选)到代理...

问带有Python 'Requests‘模块的代理
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问带有Python 'Requests‘模块的代理EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问带有Python 'Requests‘模块的代理
EN