blocks|key|975155|text|我推荐使用boto。然后这是一个快速的couple+of+lines+of+python|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|975156|from+boto.s3.connection+import+S3Connection

conn+=+S3Connection('access-key','secret-access-key')
bucket+=+conn.get_bucket('bucket')
for+key+in+bucket.list():
++++print(key.name.encode('utf-8'))|code-block|syntax|javascript|975157|将其另存为list.py，打开一个终端，然后运行：|975158|$+python+list.py+>+results.txt|975159|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/boto/boto|1|http://code.google.com/p/boto/wiki/GetAllKeys^0|5|4|0|J|P|1|0|0|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@$A|X|B|Y|1|Z]|$A|10|B|11|1|12]]|C|$]]|$1|D|3|E|5|F|7|13|8|@]|9|@]|C|$G|H]]|$1|I|3|J|5|6|7|14|8|@]|9|@]|C|$]]|$1|K|3|L|5|F|7|15|8|@]|9|@]|C|$G|H]]|$1|M|3|-4|5|6|7|16|8|@]|9|@]|C|$]]]|N|$O|$5|P|Q|R|C|$S|T]]|U|$5|P|Q|R|C|$S|V]]]]

I'd recommend using <a href="https://github.com/boto/boto" rel="nofollow noreferrer">boto</a>. Then it's a quick <a href="http://code.google.com/p/boto/wiki/GetAllKeys" rel="nofollow noreferrer">couple of lines of python</a>:
<pre class="lang-py prettyprint-override"><code>from boto.s3.connection import S3Connection

conn = S3Connection('access-key','secret-access-key')
bucket = conn.get_bucket('bucket')
for key in bucket.list():
 print(key.name.encode('utf-8'))
</code></pre>
Save this as list.py, open a terminal, and then run:
<pre><code>$ python list.py &gt; results.txt
</code></pre>

blocks|key|975281|text|对于这类事情，s3cmd是无价的。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|975282|$+s3cmd+ls+-r+s3://yourbucket/+%7C+awk+'{print+$4}'+>+objects_in_bucket|style|CODE|975283|entityMap|0|LINK|mutability|MUTABLE|url|http://s3tools.org/s3cmd^0|7|5|0|0|0|1X|0^^$0|@$1|2|3|4|5|6|7|P|8|@]|9|@$A|Q|B|R|1|S]]|C|$]]|$1|D|3|E|5|6|7|T|8|@$A|U|B|V|F|G]]|9|@]|C|$]]|$1|H|3|-4|5|6|7|W|8|@]|9|@]|C|$]]]|I|$J|$5|K|L|M|C|$N|O]]]]

<a href="http://s3tools.org/s3cmd" rel="noreferrer">s3cmd</a> is invaluable for this kind of thing

<code>$ s3cmd ls -r s3://yourbucket/ | awk '{print $4}' > objects_in_bucket</code>

blocks|key|1189509|text|小心点，amazon+list只返回1000个文件。如果要遍历所有文件，则必须使用标记对结果进行分页：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1189510|在ruby中使用aws-s3|offset|length|1189511|bucket_name+=+'yourBucket'
marker+=+""

AWS::S3::Base.establish_connection!(
++:access_key_id+=>+'your_access_key_id',
++:secret_access_key+=>+'your_secret_access_key'
)

loop+do
++objects+=+Bucket.objects(bucket_name,+:marker=>marker,+:max_keys=>1000)
++break+if+objects.size+==+0
++marker+=+objects.last.key

++objects.each+do+%7Cobj%7C
++++++puts+"#{obj.key}"
++end
end|code-block|syntax|javascript|1189512|结束|1189513|希望这能帮上忙，文森特|1189514|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/marcel/aws-s3^0|0|8|6|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|W|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|X|8|@]|9|@$D|Y|E|Z|1|10]]|A|$]]|$1|F|3|G|5|H|7|11|8|@]|9|@]|A|$I|J]]|$1|K|3|L|5|6|7|12|8|@]|9|@]|A|$]]|$1|M|3|N|5|6|7|13|8|@]|9|@]|A|$]]|$1|O|3|-4|5|6|7|14|8|@]|9|@]|A|$]]]|P|$Q|$5|R|S|T|A|$U|V]]]]

Be carefull, amazon list only returns 1000 files. If you want to iterate over all files you have to paginate the results using markers :

In ruby using <a href="https://github.com/marcel/aws-s3" rel="noreferrer">aws-s3</a>

<pre class="lang-ruby prettyprint-override"><code>bucket_name = 'yourBucket'
marker = ""

AWS::S3::Base.establish_connection!(
 :access_key_id =&gt; 'your_access_key_id',
 :secret_access_key =&gt; 'your_secret_access_key'
)

loop do
 objects = Bucket.objects(bucket_name, :marker=&gt;marker, :max_keys=&gt;1000)
 break if objects.size == 0
 marker = objects.last.key

 objects.each do |obj|
 puts "#{obj.key}"
 end
end
</code></pre>

end

Hope this helps, vincent

blocks|key|1189962|text|有几种方法可以解决这个问题。使用Python|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1189963|import+boto3

sesssion+=+boto3.Session(aws_access_key_id,+aws_secret_access_key)

s3+=+sesssion.resource('s3')

bucketName+=+'testbucket133'
bucket+=+s3.Bucket(bucketName)

for+obj+in+bucket.objects.all():
++++print(obj.key)|code-block|syntax|javascript|1189964|另一种方法是使用AWS+cli|1189965|aws+s3+ls+s3://{bucketname}
example+:+aws+s3+ls+s3://testbucket133|1189966|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

There are couple of ways you can go about it. 
Using Python 

<pre class="lang-python prettyprint-override"><code>import boto3

sesssion = boto3.Session(aws_access_key_id, aws_secret_access_key)

s3 = sesssion.resource('s3')

bucketName = 'testbucket133'
bucket = s3.Bucket(bucketName)

for obj in bucket.objects.all():
 print(obj.key)
</code></pre>

Another way is using AWS cli for it 

<pre><code>aws s3 ls s3://{bucketname}
example : aws s3 ls s3://testbucket133
</code></pre>

blocks|key|975224|text|在扎克之后，我也会推荐boto，但我需要对他的代码做一点小小的改变：|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|975225|conn+=+boto.connect_s3('access-key',+'secret'key')
bucket+=+conn.lookup('bucket-name')
for+key+in+bucket:
++++print+key.name|code-block|syntax|javascript|975226|entityMap|0|LINK|mutability|MUTABLE|url|http://code.google.com/p/boto/^0|B|4|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@$A|R|B|S|1|T]]|C|$]]|$1|D|3|E|5|F|7|U|8|@]|9|@]|C|$G|H]]|$1|I|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|J|$K|$5|L|M|N|C|$O|P]]]]

After zach I would also recommend <a href="http://code.google.com/p/boto/">boto</a>, but I needed to make a slight difference to his code:

<pre><code>conn = boto.connect_s3('access-key', 'secret'key')
bucket = conn.lookup('bucket-name')
for key in bucket:
 print key.name
</code></pre>

blocks|key|1189682|text|aws+s3api+list-objects+--bucket+bucket-name|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|1189683|有关更多详细信息，请参阅此处-+http://docs.aws.amazon.com/cli/latest/reference/s3api/list-objects.html|unstyled|offset|length|1189684|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.aws.amazon.com/cli/latest/reference/s3api/list-objects.html^0|0|G|1Z|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@]|A|$B|C]]|$1|D|3|E|5|F|7|R|8|@]|9|@$G|S|H|T|1|U]]|A|$]]|$1|I|3|-4|5|F|7|V|8|@]|9|@]|A|$]]]|J|$K|$5|L|M|N|A|$O|P]]]]

<pre><code>aws s3api list-objects --bucket bucket-name
</code></pre>

For more details see here - <a href="http://docs.aws.amazon.com/cli/latest/reference/s3api/list-objects.html" rel="noreferrer">http://docs.aws.amazon.com/cli/latest/reference/s3api/list-objects.html</a>

blocks|key|975805|text|在使用了aws+configure之后，用于Python的boto3|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|975806|import+boto3
s3+=+boto3.resource('s3')

bucket+=+s3.Bucket('name')
for+obj+in+bucket.objects.all():
++++print(obj.key)|code-block|syntax|javascript|975807|entityMap^0|4|D|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@$9|N|A|O|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|P|8|@]|D|@]|E|$I|J]]|$1|K|3|-4|5|6|7|Q|8|@]|D|@]|E|$]]]|L|$]]

For Python's boto3 after having used <code>aws configure</code>:

<pre><code>import boto3
s3 = boto3.resource('s3')

bucket = s3.Bucket('name')
for obj in bucket.objects.all():
 print(obj.key)
</code></pre>

blocks|key|976049|text|首先，确保您在instance+terminal上，并且在您正在使用的IAM中有S3的all+access。例如，我使用了一个ec2实例。|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|976050|pip3+install+awscli|code-block|syntax|javascript|976051|然后配置aws|976052|aws+configure|976053|然后填写外部凭据，例如：-|976054|$+aws+configure
AWS+Access+Key+ID+[None]:+AKIAIOSFODNN7EXAMPLE
AWS+Secret+Access+Key+[None]:+wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
Default+region+name+[None]:+us-west-2
Default+output+format+[None]:+json+(or+just+press+enter)|976055|现在，查看所有存储桶|976056|aws+s3+ls|976057|存储所有存储桶名称|976058|aws+s3+ls+>+output.txt|976059|查看存储桶中的所有文件结构|976060|aws+s3+ls+bucket-name+--recursive|976061|在每个存储桶中存储文件结构|976062|aws+s3+ls+bucket-name+--recursive+>+file_Structure.txt|976063|希望这能有所帮助。|976064|entityMap^0|7|H|Z|3|14|2|17|A|0|0|0|0|0|0|0|0|0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|1C|8|@$9|1D|A|1E|B|C]|$9|1F|A|1G|B|C]|$9|1H|A|1I|B|C]|$9|1J|A|1K|B|C]]|D|@]|E|$]]|$1|F|3|G|5|H|7|1L|8|@]|D|@]|E|$I|J]]|$1|K|3|L|5|6|7|1M|8|@]|D|@]|E|$]]|$1|M|3|N|5|H|7|1N|8|@]|D|@]|E|$I|J]]|$1|O|3|P|5|6|7|1O|8|@]|D|@]|E|$]]|$1|Q|3|R|5|H|7|1P|8|@]|D|@]|E|$I|J]]|$1|S|3|T|5|6|7|1Q|8|@]|D|@]|E|$]]|$1|U|3|V|5|H|7|1R|8|@]|D|@]|E|$I|J]]|$1|W|3|X|5|6|7|1S|8|@]|D|@]|E|$]]|$1|Y|3|Z|5|H|7|1T|8|@]|D|@]|E|$I|J]]|$1|10|3|11|5|6|7|1U|8|@]|D|@]|E|$]]|$1|12|3|13|5|H|7|1V|8|@]|D|@]|E|$I|J]]|$1|14|3|15|5|6|7|1W|8|@]|D|@]|E|$]]|$1|16|3|17|5|H|7|1X|8|@]|D|@]|E|$I|J]]|$1|18|3|19|5|6|7|1Y|8|@]|D|@]|E|$]]|$1|1A|3|-4|5|6|7|1Z|8|@]|D|@]|E|$]]]|1B|$]]

First make sure you are on an <code>instance terminal</code> and you have <code>all access</code> of <code>S3</code> in <code>IAM</code> you are using. For example I used an ec2 instance.

<pre><code>pip3 install awscli
</code></pre>

Then Configure aws

<pre><code>aws configure
</code></pre>

Then fill outcredantials ex:- 

<pre><code>$ aws configure
AWS Access Key ID [None]: AKIAIOSFODNN7EXAMPLE
AWS Secret Access Key [None]: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
Default region name [None]: us-west-2
Default output format [None]: json (or just press enter)
</code></pre>

Now, See all buckets

<pre><code>aws s3 ls
</code></pre>

Store all buckets name 

<pre><code>aws s3 ls &gt; output.txt
</code></pre>

See all file structure in a bucket

<pre><code>aws s3 ls bucket-name --recursive
</code></pre>

Store file structure in each bucket

<pre><code>aws s3 ls bucket-name --recursive &gt; file_Structure.txt
</code></pre>

Hope this helps.

blocks|key|1189652|text|在Java语言中，您可以使用ListObjects+(参见AWS+documentation)获取密钥|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|1189653|FileWriter+fileWriter;
BufferedWriter+bufferedWriter;
//+[...]

AmazonS3+s3client+=+new+AmazonS3Client(new+ProfileCredentialsProvider());++++++++

ListObjectsRequest+listObjectsRequest+=+new+ListObjectsRequest()
.withBucketName(bucketName)
.withPrefix("myprefix");
ObjectListing+objectListing;

do+{
++++objectListing+=+s3client.listObjects(listObjectsRequest);
++++for+(S3ObjectSummary+objectSummary+:+
++++++++objectListing.getObjectSummaries())+{
++++++++//+write+to+file+with+e.g.+a+bufferedWriter
++++++++bufferedWriter.write(objectSummary.getKey());
++++}
++++listObjectsRequest.setMarker(objectListing.getNextMarker());
}+while+(objectListing.isTruncated());|code-block|syntax|javascript|1189654|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.aws.amazon.com/AmazonS3/latest/dev/ListingObjectKeysUsingJava.html^0|T|H|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@$A|R|B|S|1|T]]|C|$]]|$1|D|3|E|5|F|7|U|8|@]|9|@]|C|$G|H]]|$1|I|3|-4|5|6|7|V|8|@]|9|@]|C|$]]]|J|$K|$5|L|M|N|C|$O|P]]]]

In Java you can get the keys using ListObjects (see <a href="http://docs.aws.amazon.com/AmazonS3/latest/dev/ListingObjectKeysUsingJava.html" rel="nofollow noreferrer">AWS documentation</a>)

<pre class="lang-java prettyprint-override"><code>FileWriter fileWriter;
BufferedWriter bufferedWriter;
// [...]

AmazonS3 s3client = new AmazonS3Client(new ProfileCredentialsProvider()); 

ListObjectsRequest listObjectsRequest = new ListObjectsRequest()
.withBucketName(bucketName)
.withPrefix("myprefix");
ObjectListing objectListing;

do {
 objectListing = s3client.listObjects(listObjectsRequest);
 for (S3ObjectSummary objectSummary : 
 objectListing.getObjectSummaries()) {
 // write to file with e.g. a bufferedWriter
 bufferedWriter.write(objectSummary.getKey());
 }
 listObjectsRequest.setMarker(objectListing.getNextMarker());
} while (objectListing.isTruncated());
</code></pre>

blocks|key|975359|text|用python编写代码，使用令人敬畏的"boto"+lib。该代码返回存储桶中的文件列表，并处理丢失存储桶的异常。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|975360|import+boto

conn+=+boto.connect_s3(+<ACCESS_KEY>,+<SECRET_KEY>+)
try:
++++bucket+=+conn.get_bucket(+<BUCKET_NAME>,+validate+=+True+)
except+boto.exception.S3ResponseError,+e:
++++do_something()+#+The+bucket+does+not+exist,+choose+how+to+deal+with+it+or+raise+the+exception

return+[+key.name.encode(+"utf-8"+)+for+key+in+bucket.list()+]|code-block|syntax|javascript|975361|不要忘记将<+PLACE_HOLDERS+>替换为您的值。|975362|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/boto/boto^0|J|A|0|0|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@]|9|@$A|T|B|U|1|V]]|C|$]]|$1|D|3|E|5|F|7|W|8|@]|9|@]|C|$G|H]]|$1|I|3|J|5|6|7|X|8|@]|9|@]|C|$]]|$1|K|3|-4|5|6|7|Y|8|@]|9|@]|C|$]]]|L|$M|$5|N|O|P|C|$Q|R]]]]

Code in python using the awesome <a href="https://github.com/boto/boto" rel="nofollow">"boto" lib</a>.
The code returns a list of files in a bucket and also handles exceptions for missing buckets. 

<pre class="lang-python prettyprint-override"><code>import boto

conn = boto.connect_s3( &lt;ACCESS_KEY&gt;, &lt;SECRET_KEY&gt; )
try:
 bucket = conn.get_bucket( &lt;BUCKET_NAME&gt;, validate = True )
except boto.exception.S3ResponseError, e:
 do_something() # The bucket does not exist, choose how to deal with it or raise the exception

return [ key.name.encode( "utf-8" ) for key in bucket.list() ]
</code></pre>

Don't forget to replace the &lt; PLACE_HOLDERS > with your values.

blocks|key|975482|text|你可以使用标准的s3接口-|type|unstyled|depth|inlineStyleRanges|entityRanges|data|975483|aws+s3+ls+s3://root/folder1/folder2/|code-block|syntax|javascript|975484|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

You can use standard s3 api - 

<pre><code>aws s3 ls s3://root/folder1/folder2/
</code></pre>

blocks|key|975761|text|以下命令将从您的亚马逊网络服务S3存储桶中获取所有文件名，并将其写入您当前目录中的文本文件：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|975762|aws+s3+ls+s3://Bucketdirectory/Subdirectory/+%7C+cat+>>+FileNames.txt|code-block|syntax|javascript|975763|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

The below command will get all the file names from your AWS S3 bucket and write into text file in your current directory:

<pre><code>aws s3 ls s3://Bucketdirectory/Subdirectory/ | cat &gt;&gt; FileNames.txt
</code></pre>

blocks|key|1190365|text|我知道这是一个古老的话题，但我也想做出贡献。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1190366|使用较新版本的boto3和python，您可以获得如下文件：|1190367|import+os
import+boto3
from+botocore.exceptions+import+ClientError++++

client+=+boto3.client('s3')

bucket+=+client.list_objects(Bucket=BUCKET_NAME)
for+content+in+bucket["Contents"]:
++++key+=+content["Key"]|code-block|syntax|javascript|1190368|请记住，此解决方案不包含分页。|1190369|欲了解更多信息，请访问：https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Client.list_objects|offset|length|1190370|编辑:修改Key的名称，从小写改为大写K|1190371|entityMap|0|LINK|mutability|MUTABLE|url|https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Client.list_objects^0|0|0|0|0|C|2X|0|0|0^^$0|@$1|2|3|4|5|6|7|Y|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|Z|8|@]|9|@]|A|$]]|$1|D|3|E|5|F|7|10|8|@]|9|@]|A|$G|H]]|$1|I|3|J|5|6|7|11|8|@]|9|@]|A|$]]|$1|K|3|L|5|6|7|12|8|@]|9|@$M|13|N|14|1|15]]|A|$]]|$1|O|3|P|5|6|7|16|8|@]|9|@]|A|$]]|$1|Q|3|-4|5|6|7|17|8|@]|9|@]|A|$]]]|R|$S|$5|T|U|V|A|$W|X]]]]

I know its old topic, but I'd like to contribute too.
With the newer version of boto3 and python, you can get the files as follow:
<pre><code>import os
import boto3
from botocore.exceptions import ClientError 

client = boto3.client('s3')

bucket = client.list_objects(Bucket=BUCKET_NAME)
for content in bucket[&quot;Contents&quot;]:
 key = content[&quot;Key&quot;]
</code></pre>
Keep in mind that this solution not comprehends pagination.
For more information: <a href="https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Client.list_objects" rel="nofollow noreferrer">https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Client.list_objects</a>
Edit:
Fixed the name for the &quot;Key&quot; from small to capital K

blocks|key|976206|text|以下是使用常用AWS+CLI生成对象名称的diff-able列表的方法：|type|unstyled|depth|inlineStyleRanges|offset|length|style|CODE|entityRanges|data|976207|aws+s3api+list-objects+--bucket+"$BUCKET"+--query+"Contents[].{Key:+Key}"+--output+text|976208|(基于https://stackoverflow.com/a/54378943/53529)|976209|这将为您提供存储桶中每个对象的完整对象名，并以换行符分隔。例如，如果您想在S3存储桶和GCS存储桶的内容之间进行比较，则非常有用。|976210|entityMap|0|LINK|mutability|MUTABLE|url|https://stackoverflow.com/a/54378943/53529^0|L|4|0|0|2F|0|3|16|0|0|0^^$0|@$1|2|3|4|5|6|7|T|8|@$9|U|A|V|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|W|8|@$9|X|A|Y|B|C]]|D|@]|E|$]]|$1|H|3|I|5|6|7|Z|8|@]|D|@$9|10|A|11|1|12]]|E|$]]|$1|J|3|K|5|6|7|13|8|@]|D|@]|E|$]]|$1|L|3|-4|5|6|7|14|8|@]|D|@]|E|$]]]|M|$N|$5|O|P|Q|E|$R|S]]]]

Here's a way to use the stock AWS CLI to generate a <code>diff</code>-able list of just object names:
<code>aws s3api list-objects --bucket &quot;$BUCKET&quot; --query &quot;Contents[].{Key: Key}&quot; --output text</code>
(based on <a href="https://stackoverflow.com/a/54378943/53529">https://stackoverflow.com/a/54378943/53529</a>)
This gives you the full object name of every object in the bucket, separated by new lines. Useful if you want to diff between the contents of an S3 bucket and a GCS bucket, for example.

blocks|key|975330|text|function+showUploads(){
++++if+(!class_exists('S3'))+require_once+'S3.php';
++++//+AWS+access+info
++++if+(!defined('awsAccessKey'))+define('awsAccessKey',+'234567665464tg');
++++if+(!defined('awsSecretKey'))+define('awsSecretKey',+'dfshgfhfghdgfhrt463457');
++++$bucketName+=+'my_bucket1234';
++++$s3+=+new+S3(awsAccessKey,+awsSecretKey);
++++$contents+=+$s3->getBucket($bucketName);
++++echo+"<hr/>List+of+Files+in+bucket+:+{$bucketName}+<hr/>";
++++$n+=+1;
++++foreach+($contents+as+$p+=>+$v):
++++++++echo+$p." ";
++++++++$n%2B%2B;
++++endforeach;
}|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|975331|unstyled|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|G|8|@]|9|@]|A|$B|C]]|$1|D|3|-4|5|E|7|H|8|@]|9|@]|A|$]]]|F|$]]

<pre class="lang-php prettyprint-override"><code>function showUploads(){
 if (!class_exists('S3')) require_once 'S3.php';
 // AWS access info
 if (!defined('awsAccessKey')) define('awsAccessKey', '234567665464tg');
 if (!defined('awsSecretKey')) define('awsSecretKey', 'dfshgfhfghdgfhrt463457');
 $bucketName = 'my_bucket1234';
 $s3 = new S3(awsAccessKey, awsSecretKey);
 $contents = $s3-&gt;getBucket($bucketName);
 echo "&lt;hr/&gt;List of Files in bucket : {$bucketName} &lt;hr/&gt;";
 $n = 1;
 foreach ($contents as $p =&gt; $v):
 echo $p."&lt;br/&gt;";
 $n++;
 endforeach;
}
</code></pre>

blocks|key|1189797|text|您可以使用以下命令列出aws+s3存储桶中的所有文件|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1189798|aws+s3+ls+path/to/file|code-block|syntax|javascript|1189799|要将其保存到文件中，请使用|1189800|aws+s3+ls+path/to/file+>>+save_result.txt|1189801|如果您想将结果附加到文件中，请执行以下操作：|1189802|aws+s3+ls+path/to/file+>+save_result.txt|1189803|如果您想要清除之前编写的内容。|1189804|它可以在windows和Linux上运行。|1189805|entityMap^0|0|0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|U|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|V|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|W|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|X|8|@]|9|@]|A|$E|F]]|$1|K|3|L|5|6|7|Y|8|@]|9|@]|A|$]]|$1|M|3|N|5|D|7|Z|8|@]|9|@]|A|$E|F]]|$1|O|3|P|5|6|7|10|8|@]|9|@]|A|$]]|$1|Q|3|R|5|6|7|11|8|@]|9|@]|A|$]]|$1|S|3|-4|5|6|7|12|8|@]|9|@]|A|$]]]|T|$]]

You can list all the files, in the aws s3 bucket using the command

<pre><code>aws s3 ls path/to/file
</code></pre>

and to save it in a file, use 

<pre><code>aws s3 ls path/to/file &gt;&gt; save_result.txt
</code></pre>

if you want to append your result in a file otherwise:

<pre><code>aws s3 ls path/to/file &gt; save_result.txt
</code></pre>

if you want to clear what was written before.

It will work both in windows and Linux.

blocks|key|975254|text|public+static+Dictionary<string,+DateTime>+ListBucketsByCreationDate(string+AccessKey,+string+SecretKey)++
{++

++++return+AWSClientFactory.CreateAmazonS3Client(AccessKey,
++++++++SecretKey).ListBuckets().Buckets.ToDictionary(s3Bucket+=>+s3Bucket.BucketName,
++++++++s3Bucket+=>+DateTime.Parse(s3Bucket.CreationDate));

}|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|975255|unstyled|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|G|8|@]|9|@]|A|$B|C]]|$1|D|3|-4|5|E|7|H|8|@]|9|@]|A|$]]]|F|$]]

<pre class="lang-java prettyprint-override"><code>public static Dictionary&lt;string, DateTime&gt; ListBucketsByCreationDate(string AccessKey, string SecretKey) 
{ 

 return AWSClientFactory.CreateAmazonS3Client(AccessKey,
 SecretKey).ListBuckets().Buckets.ToDictionary(s3Bucket =&gt; s3Bucket.BucketName,
 s3Bucket =&gt; DateTime.Parse(s3Bucket.CreationDate));

}
</code></pre>

blocks|key|1189629|text|在PHP中，您可以使用以下调用获取特定存储桶中的AWS-S3对象的完整列表|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1189630|$S3+=+\Aws\S3\S3Client::factory(array('region'+=>+$region,));
$iterator+=+$S3->getIterator('ListObjects',+array('Bucket'+=>+$bucket));
foreach+($iterator+as+$obj)+{
++++echo+$obj['Key'];
}|code-block|syntax|javascript|1189631|您可以将上述代码的输出重定向到一个文件中，以获取密钥列表。|1189632|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

In PHP you can get complete list of AWS-S3 objects inside specific bucket using following call

<pre class="lang-php prettyprint-override"><code>$S3 = \Aws\S3\S3Client::factory(array('region' =&gt; $region,));
$iterator = $S3-&gt;getIterator('ListObjects', array('Bucket' =&gt; $bucket));
foreach ($iterator as $obj) {
 echo $obj['Key'];
}
</code></pre>

You can redirect output of the above code in to a file to get list of keys.

blocks|key|975575|text|由Paolo提供的Scala答案的简化和更新版本：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|975576|import+scala.collection.JavaConversions.{collectionAsScalaIterable+=>+asScala}
import+com.amazonaws.services.s3.AmazonS3
import+com.amazonaws.services.s3.model.{ListObjectsRequest,+ObjectListing,+S3ObjectSummary}

def+buildListing(s3:+AmazonS3,+request:+ListObjectsRequest):+List[S3ObjectSummary]+=+{
++def+buildList(listIn:+List[S3ObjectSummary],+bucketList:ObjectListing):+List[S3ObjectSummary]+=+{
++++val+latestList:+List[S3ObjectSummary]+=+bucketList.getObjectSummaries.toList

++++if+(!bucketList.isTruncated)+listIn+:::+latestList
++++else+buildList(listIn+:::+latestList,+s3.listNextBatchOfObjects(bucketList))
++}

++buildList(List(),+s3.listObjects(request))
}|code-block|syntax|javascript|975577|去掉泛型并使用SDK+builders生成的ListObjectRequest。|975578|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|L|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|6|7|N|8|@]|9|@]|A|$]]]|J|$]]

Simplified and updated version of the Scala answer by Paolo:

<pre class="lang-scala prettyprint-override"><code>import scala.collection.JavaConversions.{collectionAsScalaIterable =&gt; asScala}
import com.amazonaws.services.s3.AmazonS3
import com.amazonaws.services.s3.model.{ListObjectsRequest, ObjectListing, S3ObjectSummary}

def buildListing(s3: AmazonS3, request: ListObjectsRequest): List[S3ObjectSummary] = {
 def buildList(listIn: List[S3ObjectSummary], bucketList:ObjectListing): List[S3ObjectSummary] = {
 val latestList: List[S3ObjectSummary] = bucketList.getObjectSummaries.toList

 if (!bucketList.isTruncated) listIn ::: latestList
 else buildList(listIn ::: latestList, s3.listNextBatchOfObjects(bucketList))
 }

 buildList(List(), s3.listObjects(request))
}
</code></pre>

Stripping out the generics and using the ListObjectRequest generated by the SDK builders.

blocks|key|975582|text|#+find+like+file+listing+for+s3+files
aws+s3api+--profile+<<profile-name>>+\
--endpoint-url=<<end-point-url>>+list-objects+\
--bucket+<<bucket-name>>+--query+'Contents[].{Key:+Key}'|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|975583|unstyled|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|G|8|@]|9|@]|A|$B|C]]|$1|D|3|-4|5|E|7|H|8|@]|9|@]|A|$]]]|F|$]]

<pre><code># find like file listing for s3 files
aws s3api --profile &lt;&lt;profile-name&gt;&gt; \
--endpoint-url=&lt;&lt;end-point-url&gt;&gt; list-objects \
--bucket &lt;&lt;bucket-name&gt;&gt; --query 'Contents[].{Key: Key}'
</code></pre>

blocks|key|1190135|text|用铅笔包装cli，你就会有一个清晰的语法：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1190136|import+plumbum+as+pb
folders+=+pb.local['aws']('s3',+'ls')|code-block|syntax|javascript|1190137|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

Use plumbum to wrap the cli and you will have a clear syntax:

<pre><code>import plumbum as pb
folders = pb.local['aws']('s3', 'ls')
</code></pre>

blocks|key|975971|text|请尝试此bash脚本。它使用curl命令，不需要任何外部依赖|type|unstyled|depth|inlineStyleRanges|entityRanges|data|975972|bucket=<bucket_name>
region=<region_name>
awsAccess=<access_key>
awsSecret=<secret_key>
awsRegion="${region}"
baseUrl="s3.${awsRegion}.amazonaws.com"

m_sed()+{
++if+which+gsed+>+/dev/null+2>&1;+then
++++gsed+"$@"
++else
++++sed+"$@"
++fi
}

awsStringSign4()+{
++kSecret="AWS4$1"
++kDate=$(printf+++++++++'%25s'+"$2"+%7C+openssl+dgst+-sha256+-hex+-mac+HMAC+-macopt+"key:${kSecret}"+++++2>/dev/null+%7C+m_sed+'s/%5E.*+//')
++kRegion=$(printf+++++++'%25s'+"$3"+%7C+openssl+dgst+-sha256+-hex+-mac+HMAC+-macopt+"hexkey:${kDate}"++++2>/dev/null+%7C+m_sed+'s/%5E.*+//')
++kService=$(printf++++++'%25s'+"$4"+%7C+openssl+dgst+-sha256+-hex+-mac+HMAC+-macopt+"hexkey:${kRegion}"++2>/dev/null+%7C+m_sed+'s/%5E.*+//')
++kSigning=$(printf+'aws4_request'+%7C+openssl+dgst+-sha256+-hex+-mac+HMAC+-macopt+"hexkey:${kService}"+2>/dev/null+%7C+m_sed+'s/%5E.*+//')
++signedString=$(printf++'%25s'+"$5"+%7C+openssl+dgst+-sha256+-hex+-mac+HMAC+-macopt+"hexkey:${kSigning}"+2>/dev/null+%7C+m_sed+'s/%5E.*+//')
++printf+'%25s'+"${signedString}"
}

if+[+-z+"${region}"+];+then
++region="${awsRegion}"
fi


#+Initialize+helper+variables

authType='AWS4-HMAC-SHA256'
service="s3"
dateValueS=$(date+-u+%2B'%25Y%25m%25d')
dateValueL=$(date+-u+%2B'%25Y%25m%25dT%25H%25M%25SZ')

#+0.+Hash+the+file+to+be+uploaded

#+1.+Create+canonical+request

#+NOTE:+order+significant+in+${signedHeaders}+and+${canonicalRequest}

signedHeaders='host;x-amz-content-sha256;x-amz-date'

canonicalRequest="\
GET
/

host:${bucket}.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:${dateValueL}

${signedHeaders}
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"

#+Hash+it

canonicalRequestHash=$(printf+'%25s'+"${canonicalRequest}"+%7C+openssl+dgst+-sha256+-hex+2>/dev/null+%7C+m_sed+'s/%5E.*+//')

#+2.+Create+string+to+sign

stringToSign="\
${authType}
${dateValueL}
${dateValueS}/${region}/${service}/aws4_request
${canonicalRequestHash}"

#+3.+Sign+the+string

signature=$(awsStringSign4+"${awsSecret}"+"${dateValueS}"+"${region}"+"${service}"+"${stringToSign}")

#+Upload

curl+-g+-k+"https://${baseUrl}/${bucket}"+\
++-H+"x-amz-content-sha256:+e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"+\
++-H+"x-amz-Date:+${dateValueL}"+\
++-H+"Authorization:+${authType}+Credential=${awsAccess}/${dateValueS}/${region}/${service}/aws4_request,SignedHeaders=${signedHeaders},Signature=${signature}"|code-block|syntax|javascript|975973|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

please try this bash script. it uses curl command with no need for any external dependencies

<pre><code>bucket=&lt;bucket_name&gt;
region=&lt;region_name&gt;
awsAccess=&lt;access_key&gt;
awsSecret=&lt;secret_key&gt;
awsRegion="${region}"
baseUrl="s3.${awsRegion}.amazonaws.com"

m_sed() {
 if which gsed &gt; /dev/null 2&gt;&amp;1; then
 gsed "$@"
 else
 sed "$@"
 fi
}

awsStringSign4() {
 kSecret="AWS4$1"
 kDate=$(printf '%s' "$2" | openssl dgst -sha256 -hex -mac HMAC -macopt "key:${kSecret}" 2&gt;/dev/null | m_sed 's/^.* //')
 kRegion=$(printf '%s' "$3" | openssl dgst -sha256 -hex -mac HMAC -macopt "hexkey:${kDate}" 2&gt;/dev/null | m_sed 's/^.* //')
 kService=$(printf '%s' "$4" | openssl dgst -sha256 -hex -mac HMAC -macopt "hexkey:${kRegion}" 2&gt;/dev/null | m_sed 's/^.* //')
 kSigning=$(printf 'aws4_request' | openssl dgst -sha256 -hex -mac HMAC -macopt "hexkey:${kService}" 2&gt;/dev/null | m_sed 's/^.* //')
 signedString=$(printf '%s' "$5" | openssl dgst -sha256 -hex -mac HMAC -macopt "hexkey:${kSigning}" 2&gt;/dev/null | m_sed 's/^.* //')
 printf '%s' "${signedString}"
}

if [ -z "${region}" ]; then
 region="${awsRegion}"
fi


# Initialize helper variables

authType='AWS4-HMAC-SHA256'
service="s3"
dateValueS=$(date -u +'%Y%m%d')
dateValueL=$(date -u +'%Y%m%dT%H%M%SZ')

# 0. Hash the file to be uploaded

# 1. Create canonical request

# NOTE: order significant in ${signedHeaders} and ${canonicalRequest}

signedHeaders='host;x-amz-content-sha256;x-amz-date'

canonicalRequest="\
GET
/

host:${bucket}.s3.amazonaws.com
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date:${dateValueL}

${signedHeaders}
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"

# Hash it

canonicalRequestHash=$(printf '%s' "${canonicalRequest}" | openssl dgst -sha256 -hex 2&gt;/dev/null | m_sed 's/^.* //')

# 2. Create string to sign

stringToSign="\
${authType}
${dateValueL}
${dateValueS}/${region}/${service}/aws4_request
${canonicalRequestHash}"

# 3. Sign the string

signature=$(awsStringSign4 "${awsSecret}" "${dateValueS}" "${region}" "${service}" "${stringToSign}")

# Upload

curl -g -k "https://${baseUrl}/${bucket}" \
 -H "x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" \
 -H "x-amz-Date: ${dateValueL}" \
 -H "Authorization: ${authType} Credential=${awsAccess}/${dateValueS}/${region}/${service}/aws4_request,SignedHeaders=${signedHeaders},Signature=${signature}"
</code></pre>

blocks|key|1190517|text|用于运行完整的链接|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1190518|aws+s3+ls+s3://bucket/+%7C+awk+'{print+$4}'+%7C+xargs+-I{}+echo+"s3://bucket/{}"|code-block|syntax|javascript|1190519|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

For getting full links run
<pre><code>aws s3 ls s3://bucket/ | awk '{print $4}' | xargs -I{} echo &quot;s3://bucket/{}&quot;
</code></pre>

blocks|key|1190483|text|这是一个老生常谈的问题，但回复的数量告诉我，很多人点击了这个页面。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1190484|我发现的最简单的方法就是使用内置的AWS+console来创建清单。它很容易设置，但第一个CSV文件可能需要48小时才能显示出来。在此之后，您可以为您选择的存储桶创建每日或每周输出。|offset|length|1190485|entityMap|0|LINK|mutability|MUTABLE|url|https://docs.aws.amazon.com/AmazonS3/latest/userguide/configure-inventory.html#configure-inventory-console^0|0|H|B|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|O|8|@]|9|@$D|P|E|Q|1|R]]|A|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|A|$]]]|G|$H|$5|I|J|K|A|$L|M]]]]

This is an old question but the number of responses tells me many people hit this page.
The easiest way I found is to just use the built in <a href="https://docs.aws.amazon.com/AmazonS3/latest/userguide/configure-inventory.html#configure-inventory-console" rel="nofollow noreferrer">AWS console</a> for creating an inventory. It's easy to set up but the first CSV file can take up to 48 hours to show up. After that you can create either a daily or weekly output to a bucket of your choosing.

blocks|key|975652|text|获取非常有用的文本文件的最简单方法是下载S3浏览器http://s3browser.com/，并使用Web生成器生成完整链接路径的列表。它非常方便，只需点击3次即可。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|975653|-Browse+to+Folder
-Select+All
-Generate+Urls|code-block|syntax|javascript|975654|祝你好运。|975655|entityMap|0|LINK|mutability|MUTABLE|url|http://s3browser.com/^0|P|L|0|0|0|0^^$0|@$1|2|3|4|5|6|7|S|8|@]|9|@$A|T|B|U|1|V]]|C|$]]|$1|D|3|E|5|F|7|W|8|@]|9|@]|C|$G|H]]|$1|I|3|J|5|6|7|X|8|@]|9|@]|C|$]]|$1|K|3|-4|5|6|7|Y|8|@]|9|@]|C|$]]]|L|$M|$5|N|O|P|C|$Q|R]]]]

The EASIEST way to get a very usable text file is to download S3 Browser <a href="http://s3browser.com/" rel="nofollow noreferrer">http://s3browser.com/</a> and use the Web URLs Generator to produce a list of complete link paths. It is very handy and involves about 3 clicks.

<pre><code>-Browse to Folder
-Select All
-Generate Urls
</code></pre>

Best of luck to you.

I have an amazon s3 bucket that has tens of thousands of filenames in it. What's the easiest way to get a text file that lists all the filenames in the bucket?

Quick way to list all files in Amazon S3 bucket?

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋 

腾讯云代码助手

CODING DevOps

Cloud Studio

SDK中心

API中心

命令行工具

我有一个亚马逊s3存储桶，里面有成千上万的文件名。获取列出存储桶中所有文件名的文本文件的最简单方法是什么？

问快速列出亚马逊S3存储桶中的所有文件的方法？
EN

回答 25

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问快速列出亚马逊S3存储桶中的所有文件的方法？EN

回答 25

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问快速列出亚马逊S3存储桶中的所有文件的方法？
EN