blocks|key|115942|text|从aws+s3+cp中使用AWS命令线接口(CLI)将需要--recursive参数来复制多个文件。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|115943|aws+s3+cp+s3://myBucket/dir+localdir+--recursive|code-block|syntax|javascript|115944|默认情况下，aws+s3+sync命令将复制整个目录。它将只复制新的/修改的文件。|115945|aws+s3+sync+s3://mybucket/dir+localdir|115946|只要做个实验就能得到你想要的结果。|115947|文档：|115948|cp命令|unordered-list-item|115949|同步命令|115950|entityMap|0|LINK|mutability|MUTABLE|url|http://aws.amazon.com/cli/|1|https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/cp.html|2|https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/sync.html^0|1|9|T|B|D|D|0|0|0|6|B|0|0|0|0|0|4|1|0|0|4|2|0^^$0|@$1|2|3|4|5|6|7|19|8|@$9|1A|A|1B|B|C]|$9|1C|A|1D|B|C]]|D|@$9|1E|A|1F|1|1G]]|E|$]]|$1|F|3|G|5|H|7|1H|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|1I|8|@$9|1J|A|1K|B|C]]|D|@]|E|$]]|$1|M|3|N|5|H|7|1L|8|@]|D|@]|E|$I|J]]|$1|O|3|P|5|6|7|1M|8|@]|D|@]|E|$]]|$1|Q|3|R|5|6|7|1N|8|@]|D|@]|E|$]]|$1|S|3|T|5|U|7|1O|8|@]|D|@$9|1P|A|1Q|1|1R]]|E|$]]|$1|V|3|W|5|U|7|1S|8|@]|D|@$9|1T|A|1U|1|1V]]|E|$]]|$1|X|3|-4|5|6|7|1W|8|@]|D|@]|E|$]]]|Y|$Z|$5|10|11|12|E|$13|14]]|15|$5|10|11|12|E|$13|16]]|17|$5|10|11|12|E|$13|18]]]]

Using <code>aws s3 cp</code> from the <a href="http://aws.amazon.com/cli/" rel="noreferrer">AWS Command-Line Interface (CLI)</a> will require the <code>--recursive</code> parameter to copy multiple files.
<pre><code>aws s3 cp s3://myBucket/dir localdir --recursive
</code></pre>
The <code>aws s3 sync</code> command will, by default, copy a whole directory. It will only copy new/modified files.
<pre><code>aws s3 sync s3://mybucket/dir localdir
</code></pre>
Just experiment to get the result you want.
Documentation:
<ul>
<li><a href="https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/cp.html" rel="noreferrer">cp command</a></li>
<li><a href="https://awscli.amazonaws.com/v2/documentation/api/latest/reference/s3/sync.html" rel="noreferrer">sync command</a></li>
</ul>

blocks|key|1931375|text|刚刚使用了AWS+CLI的第2版。对于s3选项，现在还有一个--dryrun选项，向您展示将要发生的事情：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1931376|aws+s3+--dryrun+cp+s3://bucket/filename+/path/to/dest/folder+--recursive|offset|length|style|CODE|1931377|entityMap^0|0|0|20|0^^$0|@$1|2|3|4|5|6|7|J|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|K|8|@$D|L|E|M|F|G]]|9|@]|A|$]]|$1|H|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|I|$]]

Just used version 2 of the AWS CLI. For the s3 option, there is also a --dryrun option now to show you what will happen:

<code>aws s3 --dryrun cp s3://bucket/filename /path/to/dest/folder --recursive</code>

blocks|key|1931354|text|如果您需要使用另一个配置文件，特别是交叉帐户。您需要在配置文件中添加配置文件。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1931355|[profile+profileName]
region+=+us-east-1
role_arn+=+arn:aws:iam::XXX:role/XXXX
source_profile+=+default|code-block|syntax|javascript|1931356|如果您只访问一个文件|1931357|aws+s3+cp+s3://crossAccountBucket/dir+localdir+--profile+profileName|1931358|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

In case you need to use another profile, especially cross account. you need to add the profile in the config file 

<pre><code>[profile profileName]
region = us-east-1
role_arn = arn:aws:iam::XXX:role/XXXX
source_profile = default
</code></pre>

and then if you are accessing only a single file 

<pre><code>aws s3 cp s3://crossAccountBucket/dir localdir --profile profileName
</code></pre>

<hr>

blocks|key|116008|text|在要下载单个文件的情况下，可以尝试以下命令：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|116009|aws+s3+cp+s3://bucket/filename+/path/to/dest/folder|code-block|syntax|javascript|116010|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

In the case you want to download a single file, you can try the following command:

<pre><code>aws s3 cp s3://bucket/filename /path/to/dest/folder
</code></pre>

blocks|key|1931431|text|您有很多选项可以这样做，但是最好的方法是使用AWS。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1931432|这里有一个过道：|1931433|下载并在您的计算机上安装AWS+CLI：|ordered-list-item|1931434|-+[Install+the+AWS+CLI+using+the+MSI+Installer+(Windows)](http://docs.aws.amazon.com/cli/latest/userguide/installing.html#install-msi-on-windows).
-+[Install+the+AWS+CLI+using+the+Bundled+Installer+for+Linux,+OS+X,+or+Unix](http://docs.aws.amazon.com/cli/latest/userguide/installing.html#install-bundle-other-os).|code-block|syntax|javascript|1931435|配置AWS+CLI：|1931436|​|1931437|📷|atomic|offset|length|1931438|1931439|确保输入有效的access和秘密密钥，这是在创建帐户时收到的。|style|BOLD|1931440|使用以下方法同步S3存储桶：
aws+s3同步S3://YOUR桶/yourfolder+/local/path|1931441|在上面的命令中，替换以下字段：|1931442|yourbucket/yourfolder+>>您的S3桶和要下载的文件夹。|unordered-list-item|CODE|1931443|要下载所有文件的本地系统中的/local/path+>>路径。|1931444|entityMap|0|IMAGE|mutability|IMMUTABLE|imageUrl|https://developer.qcloudimg.com/http-save/yehe-900000/debc9867151ad383fb6317469317b4b1.png|imageAlt^0|0|0|0|0|0|0|0|1|0|0|0|7|6|E|2|0|0|0|0|L|0|E|B|0^^$0|@$1|2|3|4|5|6|7|1I|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|1J|8|@]|9|@]|A|$]]|$1|D|3|E|5|F|7|1K|8|@]|9|@]|A|$]]|$1|G|3|H|5|I|7|1L|8|@]|9|@]|A|$J|K]]|$1|L|3|M|5|F|7|1M|8|@]|9|@]|A|$]]|$1|N|3|O|5|6|7|1N|8|@]|9|@]|A|$]]|$1|P|3|Q|5|R|7|1O|8|@]|9|@$S|1P|T|1Q|1|1R]]|A|$]]|$1|U|3|O|5|6|7|1S|8|@]|9|@]|A|$]]|$1|V|3|W|5|6|7|1T|8|@$S|1U|T|1V|X|Y]|$S|1W|T|1X|X|Y]]|9|@]|A|$]]|$1|Z|3|10|5|F|7|1Y|8|@]|9|@]|A|$]]|$1|11|3|12|5|6|7|1Z|8|@]|9|@]|A|$]]|$1|13|3|14|5|15|7|20|8|@$S|21|T|22|X|16]]|9|@]|A|$]]|$1|17|3|18|5|15|7|23|8|@$S|24|T|25|X|16]]|9|@]|A|$]]|$1|19|3|-4|5|6|7|26|8|@]|9|@]|A|$]]]|1A|$1B|$5|1C|1D|1E|A|$1F|1G|1H|-4]]]]

You've many options to do that, but the best one is using the AWS CLI.
Here's a walk-through:
<ol>
<li>Download and install AWS CLI in your machine:
<ul>
<li><a href="http://docs.aws.amazon.com/cli/latest/userguide/installing.html#install-msi-on-windows" rel="nofollow noreferrer">Install the AWS CLI using the MSI Installer (Windows)</a>.</li>
<li><a href="http://docs.aws.amazon.com/cli/latest/userguide/installing.html#install-bundle-other-os" rel="nofollow noreferrer">Install the AWS CLI using the Bundled Installer for Linux, OS X, or Unix</a>.</li>
</ul>
</li>
<li>Configure AWS CLI:
</li>
</ol>
<a href="https://i.stack.imgur.com/1UvKq.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/1UvKq.png" alt="enter image description here" /></a>
Make sure you input valid access and secret keys, which you received when you created the account.
<ol start="3">
<li>Sync the S3 bucket using:
<pre><code> aws s3 sync s3://yourbucket/yourfolder /local/path
</code></pre>
</li>
</ol>
In the above command, replace the following fields:
<ul>
<li><code>yourbucket/yourfolder</code> &gt;&gt; your S3 bucket and the folder that you want to download.</li>
<li><code>/local/path</code> &gt;&gt; path in your local system where you want to download all the files.</li>
</ul>

blocks|key|1931397|text|sync方法首先列出源路径和目标路径，并只复制差异(名称、大小等)。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1931398|cp+--recursive方法列出源路径，并将所有副本(覆盖)复制到目标路径。|1931399|如果您在目标路径中有可能匹配，我建议sync作为目标路径上的一个列表请求将为您节省许多不必要的PUT请求--这意味着成本更低，而且可能更快。|1931400|entityMap^0|0|4|0|0|E|0|I|4|0^^$0|@$1|2|3|4|5|6|7|L|8|@$9|M|A|N|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|O|8|@$9|P|A|Q|B|C]]|D|@]|E|$]]|$1|H|3|I|5|6|7|R|8|@$9|S|A|T|B|C]]|D|@]|E|$]]|$1|J|3|-4|5|6|7|U|8|@]|D|@]|E|$]]]|K|$]]

<code>sync</code> method first lists both source and destination paths and copies only differences (name, size etc.).
<code>cp --recursive</code> method lists source path and copies (overwrites) all to the destination path.
If you have possible matches in the destination path, I would suggest <code>sync</code> as one LIST request on the destination path will save you many unnecessary PUT requests - meaning cheaper and possibly faster.

blocks|key|1931470|text|问：aws+s3+sync+s3://myBucket/this_folder/object_file+C:\\Users\Desktop是否也会在C：\this_folder\桌面中创建"this_folder“？如果没有，那么复制/同步(包括S3的文件夹结构)的解决方案是什么？我的意思是，我有许多文件在不同的S3桶文件夹按年，月，日排序。我想用要保存的文件夹结构在本地复制它们。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|1931471|entityMap^0|2|1V|0^^$0|@$1|2|3|4|5|6|7|H|8|@$9|I|A|J|B|C]]|D|@]|E|$]]|$1|F|3|-4|5|6|7|K|8|@]|D|@]|E|$]]]|G|$]]

Question: Will <code>aws s3 sync s3://myBucket/this_folder/object_file C:\\Users\Desktop</code> create also the &quot;this_folder&quot; in C:\Users\Desktop?
If not, what would be the solution to copy/sync including the folder structure of S3? I mean I have many files in different S3 bucket folders sorted by year, month, day. I would like to copy them locally with the folder structure to be kept.

If I want to download all the contents of a directory on S3 to my local PC, which command should I use cp or sync ? 

Any help would be highly appreciated.

For example,

if I want to download all the contents of "this folder" to my desktop, would it look like this ?

<pre><code> aws s3 sync s3://"myBucket"/"this folder" C:\\Users\Desktop
</code></pre>

Downloading folders from aws s3, cp or sync?

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋 

腾讯云代码助手

CODING DevOps

Cloud Studio

SDK中心

API中心

命令行工具

如果我想将S3上目录的所有内容下载到我的本地PC上，我应该使用cp还是sync？任何帮助都将不胜感激。例如,如果我想把“这个文件夹”的所有内容下载到我的桌面上，它会像这样吗？ aws s3 sync s3://"myBucket"/"this folder" C:\\Users\Desktop

问下载文件夹从aws s3，cp还是同步？
EN

回答 7

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问下载文件夹从aws s3，cp还是同步？EN

回答 7

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问下载文件夹从aws s3，cp还是同步？
EN