短网址解析长网址python示例

做可视化比较麻烦我就没做，用文件处理的，这里需要两个文件

1、readUrl.txt文件保存需要解析的字符串

2、newUrl.txt文件保存解析完成的字符串

目录

readUrl.txt文件示例

编码示例： 

推荐获取网页URL的正则

解析结果newUrl.txt

readUrl.txt文件示例 #接龙

http://t.csdn.cn/DWodz

1. CSDN-亮点 http://t.csdn.cn/DWodz

2. 不知名白帽 http://t.csdn.cn/YO6Sm

3. 编程爱好者-阿新 http://t.csdn.cn/4suuN

4. 一一哥 https://yiyige.blog.csdn.net/article/details/120990448

5. 执久 http://t.csdn.cn/4UCQf

6. 花神庙码农@CSDN

http://t.csdn.cn/t9moE

7. 木木 http://t.csdn.cn/aalnU

8. 挽·烽 http://t.csdn.cn/LaZIz

高质量三连回访

9. 六月暴雪飞梨花 http://t.csdn.cn/VqL0s

10. 风铃听雨～ http://t.csdn.cn/9fkAT

11. 东非不开森 http://t.csdn.cn/fZa8s 开学季征文 如有时间愿意看的，可以指点一下嘿嘿 谢谢啦🥰🥰

12. 小明java问道之路 经验文 | 编程的上帝视角是什么？感兴趣的可以看看

http://t.csdn.cn/ffDdq

硬核深度文 | 精通内核-CPU控制并发原理CPU中断控制

http://t.csdn.cn/UZ6kN

💖在线求个一键三连💖

13. AKA|布鲁克林欧神仙 https://blog.csdn.net/m0_54594153/article/details/126661839?spm=1001.2014.3001.5501高质量三连回访

14. 阿提说说 http://t.csdn.cn/K3KSU

15. DDD666🍭 http://t.csdn.cn/2zn4R

16. 付文龙（爱吃回锅肉）红目香薰 http://t.csdn.cn/kqcPv

17. Bourne http://t.csdn.cn/ndJvc

18. 秦羽 http://t.csdn.cn/nn0cO

19. 宁采桃花不采臣 http://t.csdn.cn/nqgEK

2.​Code For Better

20. CSDN-北极的三哈

http://t.csdn.cn/Zn1WF

21. promise https://blog.csdn.net/m0_71485750/article/details/126427221 互三互粉

22. Beyond https://blog.csdn.net/chuxinchangcun/article/details/126681915

编码示例： 

import requests
import re

file = open("readUrl.txt", "r", encoding="utf-8")
strListArr = file.readlines()
strList = "".join(strListArr)
file.close()
headers = {
    "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36"
}

rep="http[s]?://(?:[a-zA-Z]|[0-9]|[$-_@.&+]|[!*\(\),]|(?:%[0-9a-fA-F][0-9a-fA-F]))+"

listUrl = re.findall(rep, strList)

list_not_dup = list()
for i in listUrl:
    if i not in list_not_dup:
        list_not_dup.append(i)

for item in list_not_dup:
    print(item)

strUrl = ""
for item in list_not_dup:
    html = requests.get(item, headers).url
    result = html.split("?")
    strUrl += result[0] + "\n"

file = open("newUrl.txt", "w", encoding="utf-8")
file.write(strUrl)
file.close()

推荐获取网页URL的正则

"http[s]?://(?:[a-zA-Z]|[0-9]|[$-_@.&+]|[!*\(\),]|(?:%[0-9a-fA-F][0-9a-fA-F]))+" 

解析结果newUrl.txt

https://blog.csdn.net/CSDN_anhl/article/details/126240868

https://blog.csdn.net/m0_63127854/article/details/126682845

https://blog.csdn.net/m0_47419053/article/details/126679490

https://yiyige.blog.csdn.net/article/details/120990448

https://blog.csdn.net/weixin_60719453/article/details/126674166

https://blog.csdn.net/qxhgd/article/details/115391385

https://blog.csdn.net/m0_64102491/article/details/126673956

https://blog.csdn.net/Fire_Cloud_1/article/details/126669683

https://blog.csdn.net/L_Lycos/article/details/126614374

https://blog.csdn.net/muzi_longren/article/details/126654597

https://blog.csdn.net/m0_62159662/article/details/126653214

https://blog.csdn.net/FMC_WBL/article/details/126683043

https://blog.csdn.net/FMC_WBL/article/details/126575914

https://blog.csdn.net/m0_54594153/article/details/126661839

https://blog.csdn.net/weixin_40972073/article/details/126682094

https://blog.csdn.net/BIT_666/article/details/126656554

https://blog.csdn.net/feng8403000/article/details/126674232

https://blog.csdn.net/qq_44631587/article/details/126667516

https://blog.csdn.net/qq_43585922/article/details/126685211

https://blog.csdn.net/m0_65909361/article/details/126599073

https://blog.csdn.net/m0_68744965/article/details/126471630

https://blog.csdn.net/m0_71485750/article/details/126427221

https://blog.csdn.net/chuxinchangcun/article/details/126681915