blocks|key|323526|text|您所描述的情况似乎是不可能的:查看云存储库中的文档和源代码只剩下3个选项:从文件(已经在磁盘中)上载、提供文件名(已在磁盘中的文件的路径)和从字符串(将文本上传为.txt文件)。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|323527|您需要从您提到的任何程序中下载该文件(如注释中提到的，您可以将其下载到一个时态文件夹)，将该文件上载到GCS，然后从您的时态文件夹中删除它。|323528|entityMap|0|LINK|mutability|MUTABLE|url|https://googleapis.github.io/google-cloud-python/latest/storage/blobs.html#google.cloud.storage.blob.Blob.upload_from_file^0|H|4|0|0|0^^$0|@$1|2|3|4|5|6|7|N|8|@]|9|@$A|O|B|P|1|Q]]|C|$]]|$1|D|3|E|5|6|7|R|8|@]|9|@]|C|$]]|$1|F|3|-4|5|6|7|S|8|@]|9|@]|C|$]]]|G|$H|$5|I|J|K|C|$L|M]]]]

The situation you are describing doesn't seem possible: looking at the documentation and source code for the <a href="https://googleapis.github.io/google-cloud-python/latest/storage/blobs.html#google.cloud.storage.blob.Blob.upload_from_file" rel="nofollow noreferrer">Cloud Storage library</a> in Python only leave you 3 options: upload from file (already in your disk), upload providing a filename (a path to a file already in your disk) and upload from string (upload a text as a .txt file). 

You will need to download the file from whichever program you mention (as mentioned in the comments, you can download it to a temporal folder), upload the file to GCS and then delete it from your temporal folder.

blocks|key|1865787|text|据我所知，除了gsutil流之外，您还在寻找另一种技术来直接存储到桶中。考虑到您已经有了Python的命令应用程序。要实现你的目标，你有几个选择：|type|unstyled|depth|inlineStyleRanges|offset|length|style|BOLD|entityRanges|data|1865788|选项1：将数据存储到python变量中，然后借助boto客户端库插件+(使用boto客户端库插件：2.6.x和2.7.x+)将其推入桶中|1865789|概述了如何在这里中使用boto+(加上使用示例)。|1865790|但是，这里是该链接的复制/粘贴版本，并提供了简要说明。|1865791|上传：|1865792|dst_uri+=+boto.storage_uri(+%2B+'/‘%2B，'gs')+dst_uri.new_key().set_contents_from_stream()|1865793|下载：|1865794|导入sys+src_uri+=+boto.storage_uri(+%2B+'/‘%2B，'gs')+src_uri.get_key().get_file(sys.stdout)|1865795|其中:桶是你设置的应用程序桶名，对象是你想要存储的对象(你可以在你的GCP控制台找到你的桶名的信息)。另外，GCS存储桶的好处在于，您可以将任何想要存储的内容存储到其中(即:不需要指定存储的内容或在存储之前对任何内容进行编码)。|1865796|选项2：使用Google云存储客户端库存储数据。更准确地说，在上传对象的帮助下，您在自己的情况下寻找的功能是斑点。(您也可以在blob中存储任何形式的数据)|1865797|由于您是这样做的，所以而不是想要在本地保存并直接将存储到桶中。我建议采用以下方法：|1865798|upload_from_string(data，content_type=‘text/平原’，client=None，redefined_acl=None)|1865799|(：从提供的字符串上传此blob的内容)|1865800|在此方法中要注意的重要一点是，您可以设置要存储的数据的类型。根据您想要存储的内容(从第三方url下载的库)，您可以在应激或字节数之间进行选择。但是，我建议首先尝试字节，因为它允许ASCII字符。|1865801|entityMap|0|LINK|mutability|MUTABLE|url|https://cloud.google.com/storage/docs/boto-plugin#uploading-objects|1|2|https://cloud.google.com/storage/docs/streaming#streaming_uploads_and_downloads_using_python_and_the_boto_plugin|3|https://cloud.google.com/storage/docs/reference/libraries#client-libraries-install-python|4|https://cloud.google.com/storage/docs/uploading-objects#storage-upload-object-code_sample|5|https://googleapis.github.io/google-cloud-python/latest/storage/blobs.html#google.cloud.storage.blob.Blob.upload_from_string|6|https://docs.python.org/3/library/stdtypes.html#str|7|https://docs.python.org/3/library/stdtypes.html#bytes^0|7|7|0|0|3|O|A|0|12|A|1|0|6|2|2|0|0|0|3|0|0|0|3|0|0|0|0|3|6|D|3|V|4|4|1I|2|5|0|B|3|P|G|0|0|26|0|0|K|0|0|2P|1M|2|6|1P|3|7|0^^$0|@$1|2|3|4|5|6|7|1Q|8|@$9|1R|A|1S|B|C]]|D|@]|E|$]]|$1|F|3|G|5|6|7|1T|8|@$9|1U|A|1V|B|C]]|D|@$9|1W|A|1X|1|1Y]|$9|1Z|A|20|1|21]]|E|$]]|$1|H|3|I|5|6|7|22|8|@]|D|@$9|23|A|24|1|25]]|E|$]]|$1|J|3|K|5|6|7|26|8|@]|D|@]|E|$]]|$1|L|3|M|5|6|7|27|8|@$9|28|A|29|B|C]]|D|@]|E|$]]|$1|N|3|O|5|6|7|2A|8|@]|D|@]|E|$]]|$1|P|3|Q|5|6|7|2B|8|@$9|2C|A|2D|B|C]]|D|@]|E|$]]|$1|R|3|S|5|6|7|2E|8|@]|D|@]|E|$]]|$1|T|3|U|5|6|7|2F|8|@]|D|@]|E|$]]|$1|V|3|W|5|6|7|2G|8|@$9|2H|A|2I|B|C]]|D|@$9|2J|A|2K|1|2L]|$9|2M|A|2N|1|2O]|$9|2P|A|2Q|1|2R]]|E|$]]|$1|X|3|Y|5|6|7|2S|8|@$9|2T|A|2U|B|C]|$9|2V|A|2W|B|C]]|D|@]|E|$]]|$1|Z|3|10|5|6|7|2X|8|@$9|2Y|A|2Z|B|C]]|D|@]|E|$]]|$1|11|3|12|5|6|7|30|8|@$9|31|A|32|B|C]]|D|@]|E|$]]|$1|13|3|14|5|6|7|33|8|@$9|34|A|35|B|C]]|D|@$9|36|A|37|1|38]|$9|39|A|3A|1|3B]]|E|$]]|$1|15|3|-4|5|6|7|3C|8|@]|D|@]|E|$]]]|16|$17|$5|18|19|1A|E|$1B|1C]]|1D|$5|18|19|1A|E|$1B|1C]]|1E|$5|18|19|1A|E|$1B|1F]]|1G|$5|18|19|1A|E|$1B|1H]]|1I|$5|18|19|1A|E|$1B|1J]]|1K|$5|18|19|1A|E|$1B|1L]]|1M|$5|18|19|1A|E|$1B|1N]]|1O|$5|18|19|1A|E|$1B|1P]]]]

From what I understand, you are in search for another technique aside from gsutil stream to store into your bucket directly. Considering that you have a command application of Python already. You have a couple of options to achieve your goal:
Option 1: Store your data into a python variable then push it into your bucket with the help of <a href="https://cloud.google.com/storage/docs/boto-plugin#uploading-objects" rel="nofollow noreferrer">boto client library plugin</a> (which uses Python: 2.6.x and 2.7.x )
The Google documentation <a href="https://cloud.google.com/storage/docs/streaming#streaming_uploads_and_downloads_using_python_and_the_boto_plugin" rel="nofollow noreferrer">here</a> outlines the idea of how to utilize boto within Python ( plus usage examples ).
However, here is copy/paste version of that link with a brief description provided.
upload:
dst_uri = boto.storage_uri( + '/' + , 'gs')
dst_uri.new_key().set_contents_from_stream()
download:
import sys
src_uri = boto.storage_uri( + '/' + , 'gs')
src_uri.get_key().get_file(sys.stdout)
Where:
bucket is your app bucket name that you have set up and object being the object you wish to store ( you can find the information for your bucket-name in your GCP console). Also, the great thing about GCS buckets is that you can literally store anything you want into it (i.e: no need to specify what you are storing or encode anything before storing ).
Option 2: Store your data using <a href="https://cloud.google.com/storage/docs/reference/libraries#client-libraries-install-python" rel="nofollow noreferrer">Google Cloud Storage Client Libraries</a>. To be more precise, the functionality that you are looking for in your situation is <a href="https://cloud.google.com/storage/docs/uploading-objects#storage-upload-object-code_sample" rel="nofollow noreferrer">uploading objects</a> with the help of <a href="https://googleapis.github.io/google-cloud-python/latest/storage/blobs.html#google.cloud.storage.blob.Blob.upload_from_string" rel="nofollow noreferrer">blob</a>. ( you can store any form of data inside a blob as well )
Since you do not want to save locally and store directly into your bucket. It would be my recommendation to use the following method:
upload_from_string(data, content_type='text/plain', client=None, redefined_acl=None)
(Google definition: Upload contents of this blob from the provided string)
The important thing to note in this method is that you can set which type of data you want to store. Depending on what you are trying to store ( libraries that download from 3rd party url’s ) you can choose between <a href="https://docs.python.org/3/library/stdtypes.html#str" rel="nofollow noreferrer">str</a> or <a href="https://docs.python.org/3/library/stdtypes.html#bytes" rel="nofollow noreferrer">bytes</a>. However, it would be my recommendation to try bytes first as it allows ASCII characters.

I want to download data from python application/command (for eg: youtube-dl or any other library that download from 3rd party url) directly to google cloud storage(Bucket).

I have used gsutil stream command to stream data directly from process to gcs, but it saves only console output to bucket

Also i don't want to mount storage because i want to share that storage with distributed system

Is there any way in which i can download it without downloading on file system first and then copying it to google cloud storage ?

Thanks,

Download data directly to google cloud storage

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

我想从python应用程序/命令(例如: youtube-dl或从第三方url下载的任何其他库)直接下载数据到google云存储(Bucket)。我使用gsutil流命令直接将数据从进程流流到gcs，但它只保存了控制台输出的到桶。另外，我不想挂载存储，因为我想与分布式系统共享存储有什么方法可以不先在文件系统上下载，然后...

问直接下载数据到google云存储
EN

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问直接下载数据到google云存储EN

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问直接下载数据到google云存储
EN