blocks|key|2013355|text|作为另一种选择：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2013356|$+curl+-i+http://google.com
HTTP/1.1+301+Moved+Permanently
Location:+http://www.google.com/
Content-Type:+text/html;+charset=UTF-8
Date:+Sat,+19+Jun+2010+04:15:10+GMT
Expires:+Mon,+19+Jul+2010+04:15:10+GMT
Cache-Control:+public,+max-age=2592000
Server:+gws
Content-Length:+219
X-XSS-Protection:+1;+mode=block

<HTML><HEAD><meta+http-equiv="content-type"+content="text/html;charset=utf-8">
<TITLE>301+Moved</TITLE></HEAD><BODY>
<H1>301+Moved</H1>
The+document+has+moved
<A+HREF="http://www.google.com/">here</A>.
</BODY></HTML>|code-block|syntax|javascript|2013357|但它不会超过第一个。|2013358|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

as another option:

<pre><code>$ curl -i http://google.com
HTTP/1.1 301 Moved Permanently
Location: http://www.google.com/
Content-Type: text/html; charset=UTF-8
Date: Sat, 19 Jun 2010 04:15:10 GMT
Expires: Mon, 19 Jul 2010 04:15:10 GMT
Cache-Control: public, max-age=2592000
Server: gws
Content-Length: 219
X-XSS-Protection: 1; mode=block

&lt;HTML&gt;&lt;HEAD&gt;&lt;meta http-equiv="content-type" content="text/html;charset=utf-8"&gt;
&lt;TITLE&gt;301 Moved&lt;/TITLE&gt;&lt;/HEAD&gt;&lt;BODY&gt;
&lt;H1&gt;301 Moved&lt;/H1&gt;
The document has moved
&lt;A HREF="http://www.google.com/"&gt;here&lt;/A&gt;.
&lt;/BODY&gt;&lt;/HTML&gt;
</code></pre>

But it doesn't go past the first one.

blocks|key|1799697|text|谢谢。我最终实现了您的建议:+curl+-i+%2B+grep|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1799698|curl+-i+http://google.com+-L+%7C+egrep+-A+10+'301+Moved+Permanently%7C302+Found'+%7C+grep+'Location'+%7C+awk+-F':+'+'{print+$2}'+%7C+tail+-1|code-block|syntax|javascript|1799699|如果网站没有重定向，则返回空白，但这对我来说已经足够了，因为它在连续的重定向上工作。|1799700|可能有but，但乍一看它工作得很好。|1799701|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|P|8|@]|9|@]|A|$]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

Thank you. I ended up implementing your suggestions: curl -i + grep

<pre><code>curl -i http://google.com -L | egrep -A 10 '301 Moved Permanently|302 Found' | grep 'Location' | awk -F': ' '{print $2}' | tail -1
</code></pre>

Returns blank if the website doesn't redirect, but that's good enough for me as it works on consecutive redirections.

Could be buggy, but at a glance it works ok.

blocks|key|1799756|text|通常你可以用wget来做这件事。wget+--content-disposition+"url“另外，如果你添加了url，你实际上不会保存这个文件。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1799757|wget+-O+/dev/null+--content-disposition+example.com|1799758|entityMap^0|G|Q|0|0|1F|0^^$0|@$1|2|3|4|5|6|7|J|8|@$9|K|A|L|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|M|8|@$9|N|A|O|B|C]]|D|@]|E|$]]|$1|H|3|-4|5|6|7|P|8|@]|D|@]|E|$]]]|I|$]]

You can do this with wget usually. <code>wget --content-disposition</code> "url" additionally if you add <code>-O /dev/null</code> you will not be actually saving the file. 

<code>wget -O /dev/null --content-disposition example.com</code>

blocks|key|1799778|text|这将会起作用：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1799779|+curl+-I+somesite.com+%7C+perl+-n+-e+'/%5ELocation:+(.*)$/+&&+print+"$1\n"'|code-block|syntax|javascript|1799780|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

This would work:

<pre><code> curl -I somesite.com | perl -n -e '/^Location: (.*)$/ &amp;&amp; print "$1\n"'
</code></pre>

blocks|key|2013595|text|参数-L+(--location)和-I+(--head)仍然对location-url执行不必要的头部请求。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|2013596|如果您确定您将有不超过一个重定向，最好禁用跟随位置，并使用curl变量%25{redirect_url}。|2013597|这段代码只对指定的URL执行一次HEAD-request，并从location-header获取redirect_url：|2013598|curl+--head+--silent+--write-out+"%25{redirect_url}\n"+--output+/dev/null+"https://""goo.gl/QeJeQ4"|code-block|syntax|javascript|2013599|2013600|速度测试|2013601|all_videos_link.txt+-+50个重定向到youtube的goo.gl%2Bbit.ly链接|2013602|1.使用follow位置|2013603|time+while+read+-r+line;+do
++++curl+-kIsL+-w+"%25{url_effective}\n"+-o+/dev/null++$line
done+<+all_videos_link.txt|2013604|结果：|2013605|real++++1m40.832s
user++++0m9.266s
sys+++++0m15.375s|2013606|2.没有跟随位置|2013607|time+while+read+-r+line;+do
++++curl+-kIs+-w+"%25{redirect_url}\n"+-o+/dev/null++$line
done+<+all_videos_link.txt|2013608|2013609|real++++0m51.037s
user++++0m5.297s
sys+++++0m8.094s|2013610|entityMap^0|2|F|I|B|0|0|0|0|0|0|0|J|0|0|0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|1A|8|@$9|1B|A|1C|B|C]|$9|1D|A|1E|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|1F|8|@]|D|@]|E|$]]|$1|H|3|I|5|6|7|1G|8|@]|D|@]|E|$]]|$1|J|3|K|5|L|7|1H|8|@]|D|@]|E|$M|N]]|$1|O|3|-4|5|6|7|1I|8|@]|D|@]|E|$]]|$1|P|3|Q|5|6|7|1J|8|@]|D|@]|E|$]]|$1|R|3|S|5|6|7|1K|8|@$9|1L|A|1M|B|C]]|D|@]|E|$]]|$1|T|3|U|5|6|7|1N|8|@]|D|@]|E|$]]|$1|V|3|W|5|L|7|1O|8|@]|D|@]|E|$M|N]]|$1|X|3|Y|5|6|7|1P|8|@]|D|@]|E|$]]|$1|Z|3|10|5|L|7|1Q|8|@]|D|@]|E|$M|N]]|$1|11|3|12|5|6|7|1R|8|@]|D|@]|E|$]]|$1|13|3|14|5|L|7|1S|8|@]|D|@]|E|$M|N]]|$1|15|3|Y|5|6|7|1T|8|@]|D|@]|E|$]]|$1|16|3|17|5|L|7|1U|8|@]|D|@]|E|$M|N]]|$1|18|3|-4|5|6|7|1V|8|@]|D|@]|E|$]]]|19|$]]

The parameters <code>-L (--location)</code> and <code>-I (--head)</code> still doing unnecessary HEAD-request to the location-url.
If you are sure that you will have no more than one redirect, it is better to disable follow location and use a curl-variable %{redirect_url}.
This code do only one HEAD-request to the specified URL and takes redirect_url from location-header:
<pre><code>curl --head --silent --write-out &quot;%{redirect_url}\n&quot; --output /dev/null &quot;https://&quot;&quot;goo.gl/QeJeQ4&quot;
</code></pre>
<hr />
<h2>Speed test</h2>
<code>all_videos_link.txt</code> - 50 links of goo.gl+bit.ly which redirect to youtube
<h3>1. With follow location</h3>
<pre><code>time while read -r line; do
 curl -kIsL -w &quot;%{url_effective}\n&quot; -o /dev/null $line
done &lt; all_videos_link.txt
</code></pre>
Results:
<pre><code>real 1m40.832s
user 0m9.266s
sys 0m15.375s
</code></pre>
<h3>2. Without follow location</h3>
<pre><code>time while read -r line; do
 curl -kIs -w &quot;%{redirect_url}\n&quot; -o /dev/null $line
done &lt; all_videos_link.txt
</code></pre>
Results:
<pre><code>real 0m51.037s
user 0m5.297s
sys 0m8.094s
</code></pre>

blocks|key|1799905|text|curl只能遵循http重定向。为了遵循meta刷新指令和javascript重定向，你需要一个成熟的浏览器，比如headless+chrome：|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1799906|#!/bin/bash
real_url+()+{
++++printf+'location.href\nquit\n'+%7C+\
++++chromium-browser+--headless+--disable-gpu+--disable-software-rasterizer+\
++++--disable-dev-shm-usage+--no-sandbox+--repl+"$@"+2>+/dev/null+\
++++%7C+tr+-d+'>>>+'+%7C+jq+-r+'.result.value'
}|code-block|syntax|javascript|1799907|如果你没有安装chrome，你可以在docker容器中使用它：|1799908|#!/bin/bash
real_url+()+{
++++printf+'location.href\nquit\n'+%7C+\
++++docker+run+-i+--rm+--user+"$(id+-u+"$USER")"+--volume+"$(pwd)":/usr/src/app+\
++++zenika/alpine-chrome+--no-sandbox+--repl+"$@"+2>+/dev/null+\
++++%7C+tr+-d+'>>>+'+%7C+jq+-r+'.result.value'
}|1799909|如下所示：|1799910|$+real_url+http://dx.doi.org/10.1016/j.pgeola.2020.06.005+
https://www.sciencedirect.com/science/article/abs/pii/S0016787820300638?via%253Dihub|1799911|entityMap^0|0|4|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@$9|V|A|W|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|X|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|Y|8|@]|D|@]|E|$]]|$1|M|3|N|5|H|7|Z|8|@]|D|@]|E|$I|J]]|$1|O|3|P|5|6|7|10|8|@]|D|@]|E|$]]|$1|Q|3|R|5|H|7|11|8|@]|D|@]|E|$I|J]]|$1|S|3|-4|5|6|7|12|8|@]|D|@]|E|$]]]|T|$]]

<code>curl</code> can only follow http redirects. To also follow meta refresh directives and javascript redirects, you need a full-blown browser like headless chrome:
<pre><code>#!/bin/bash
real_url () {
 printf 'location.href\nquit\n' | \
 chromium-browser --headless --disable-gpu --disable-software-rasterizer \
 --disable-dev-shm-usage --no-sandbox --repl &quot;$@&quot; 2&gt; /dev/null \
 | tr -d '&gt;&gt;&gt; ' | jq -r '.result.value'
}
</code></pre>
If you don't have chrome installed, you can use it from a docker container:
<pre><code>#!/bin/bash
real_url () {
 printf 'location.href\nquit\n' | \
 docker run -i --rm --user &quot;$(id -u &quot;$USER&quot;)&quot; --volume &quot;$(pwd)&quot;:/usr/src/app \
 zenika/alpine-chrome --no-sandbox --repl &quot;$@&quot; 2&gt; /dev/null \
 | tr -d '&gt;&gt;&gt; ' | jq -r '.result.value'
}
</code></pre>
Like so:
<pre><code>$ real_url http://dx.doi.org/10.1016/j.pgeola.2020.06.005 
https://www.sciencedirect.com/science/article/abs/pii/S0016787820300638?via%3Dihub
</code></pre>

blocks|key|2013256|text|我不确定如何使用curl执行此操作，但libwww-perl会安装GET别名。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2013257|$+GET+-S+-d+-e+http://google.com
GET+http://google.com+-->+301+Moved+Permanently
GET+http://www.google.com/+-->+302+Found
GET+http://www.google.ca/+-->+200+OK
Cache-Control:+private,+max-age=0
Connection:+close
Date:+Sat,+19+Jun+2010+04:11:01+GMT
Server:+gws
Content-Type:+text/html;+charset=ISO-8859-1
Expires:+-1
Client-Date:+Sat,+19+Jun+2010+04:11:01+GMT
Client-Peer:+74.125.155.105:80
Client-Response-Num:+1
Set-Cookie:+PREF=ID=a1925ca9f8af11b9:TM=1276920661:LM=1276920661:S=ULFrHqOiFDDzDVFB;+expires=Mon,+18-Jun-2012+04:11:01+GMT;+path=/;+domain=.google.ca
Title:+Google
X-XSS-Protection:+1;+mode=block|code-block|syntax|javascript|2013258|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

I'm not sure how to do it with curl, but libwww-perl installs the GET alias.

<pre><code>$ GET -S -d -e http://google.com
GET http://google.com --&gt; 301 Moved Permanently
GET http://www.google.com/ --&gt; 302 Found
GET http://www.google.ca/ --&gt; 200 OK
Cache-Control: private, max-age=0
Connection: close
Date: Sat, 19 Jun 2010 04:11:01 GMT
Server: gws
Content-Type: text/html; charset=ISO-8859-1
Expires: -1
Client-Date: Sat, 19 Jun 2010 04:11:01 GMT
Client-Peer: 74.125.155.105:80
Client-Response-Num: 1
Set-Cookie: PREF=ID=a1925ca9f8af11b9:TM=1276920661:LM=1276920661:S=ULFrHqOiFDDzDVFB; expires=Mon, 18-Jun-2012 04:11:01 GMT; path=/; domain=.google.ca
Title: Google
X-XSS-Protection: 1; mode=block
</code></pre>

blocks|key|2013621|text|你能试一下吗？|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2013622|#!/bin/bash+
LOCATION=`curl+-I+'http://your-domain.com/url/redirect?r=something&a=values-VALUES_FILES&e=zip'+%7C+perl+-n+-e+'/%5ELocation:+(.*)$/+&&+print+"$1\n"'`+
echo+"$LOCATION"|code-block|syntax|javascript|2013623|注意:当您执行命令curl时，-I+http://your-domain.com必须在命令中使用单引号，如curl+-I+'http://your-domain.com'|offset|length|style|CODE|2013624|entityMap|0|LINK|mutability|MUTABLE|url|http://your-domain.com/^0|0|0|1H|W|I|M|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|V|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|W|8|@$I|X|J|Y|K|L]]|9|@$I|Z|J|10|1|11]]|A|$]]|$1|M|3|-4|5|6|7|12|8|@]|9|@]|A|$]]]|N|$O|$5|P|Q|R|A|$S|T]]]]

Can you try with it?

<pre><code>#!/bin/bash 
LOCATION=`curl -I 'http://your-domain.com/url/redirect?r=something&amp;a=values-VALUES_FILES&amp;e=zip' | perl -n -e '/^Location: (.*)$/ &amp;&amp; print "$1\n"'` 
echo "$LOCATION"
</code></pre>

Note: when you execute the command curl -I <a href="http://your-domain.com" rel="nofollow noreferrer">http://your-domain.com</a> have to use single quotes in the command like <code>curl -I 'http://your-domain.com'</code>

blocks|key|1799484|text|您可以使用grep。wget不会告诉你它正在重定向到哪里吗？只要把它弄出来就行。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1799485|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

You could use grep. doesn't wget tell you where it's redirecting too? Just grep that out.

I need to get the final URL after a page redirect preferably with curl or wget.

For example <a href="http://google.com" rel="noreferrer">http://google.com</a> may redirect to <a href="http://www.google.com" rel="noreferrer">http://www.google.com</a>.

The contents are easy to get(ex. <code>curl --max-redirs 10 http://google.com -L</code>), but I'm only interested in the final url (in the former case <a href="http://www.google.com" rel="noreferrer">http://www.google.com</a>).

Is there any way of doing this by using only Linux built-in tools? (command line only)

Get final URL after curl is redirected

容器

Docker

Linux

我需要在页面重定向后获得最终的URL，最好是使用curl或wget。例如，可能会重定向到。内容很容易获得(例如：curl --max-redirs 10 http://google.com -L)，但我只对最后的url感兴趣(在前面的例子中是)。有没有办法只使用Linux内置的工具来做到这一点？(仅限命令行)

问curl重定向后获取最终URL
EN

回答 9

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问curl重定向后获取最终URLEN

回答 9

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问curl重定向后获取最终URL
EN