多媒体是混元生文的一种能力,本文档旨在介绍多媒体的类型和使用方式。
目前支持的多媒体类型
图片、音乐。
使用方法
1. 使用腾讯云 SDK 调用 ChatCompletions 接口时,添加 EnableMultimedia 参数。
2. 可以在 API Explorer 调试本功能, 打开 EnableMultimedia 参数开关,生成、下载各编程语言的调用示例代码。
3. 在拿到的响应体中,会返回 Replaces 属性,使用其 Multimedia 对象,即可获取图片、音乐等内容。请参考下方请求、响应示例和处理示例代码。
请求及响应参数说明
开启多媒体后,模型在生成答案的时候,会在合适的位置插入占位符 [](@replace=0),并在输出参数 Replaces 中返回对应的多媒体信息,具体示例请参考下文“输出示例”部分。实际应用中需要调用方用多媒体信息替换回复内容里的占位符实现定制化的消息。
说明:
1. 可能会出现回复内容里存在占位符,但是因为审核等原因没有返回多媒体信息,需要调用方自己处理。
2. 流式输出中每个多媒体信息(Replace)只输出一次,不会重复输出。
输入参数:


输出参数:








多媒体分类
按照多媒体检索逻辑划分
BOX 型
在响应体中,开始响应时,就返回出所有的多媒体信息。
展示效果:


图文混排型
在生成答案的同时检索出多媒体信息。
开始输出时,展示效果:


返回内容,替换图片链接之后,展示效果:


您需要在响应体中返回资源时,替换之前的资源地址。
具体请参考下方 流式、非流式示例。
按照多媒体类型划分
图片类
检索出的多媒体类型为图片(Multimedia.Type = image)。
音乐类
模型原始输出样例
BOX 型非流式输出样例
输入示例
POST / HTTP/1.1Host: hunyuan.tencentcloudapi.comContent-Type: application/jsonX-TC-Action: ChatCompletions<公共请求参数>{"Model": "hunyuan-turbo","EnableEnhancement": true,"EnableMultimedia": true,"Messages": [{"Role": "user","Content": "介绍一下腾讯云"}]}
输出示例
{"Response": {"RequestId": "4a614944-dc12-40a2-8369-00cb4b8c5e27","Note": "以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices": [{"Message": {"Role": "assistant","Content": "[](@replace=0)\\n腾讯云是腾讯公司推出的云端运算服务,提供全球领先的云计算、大数据、人工智能等技术产品与服务。它是中国最早涉足云计算领域的公司之一,自2010年正式对外提供云服务以来,腾讯云已经发展成为全球领先的云服务提供商之一[4](@ref)。以下是关于腾讯云的相关信息:\\n\\n### 腾讯云的主要服务\\n\\n- **云服务器**:提供高性能、易运维、智能化、弹性化的云服务。\\n- **云存储**:为各种业务场景提供全栈解决方案。\\n- **云数据库**:支持多种数据库服务,满足企业不同的数据存储和管理需求。\\n- **AI与机器学习**:提供混元大模型等AI服务,助力企业智能化升级。\\n- **安全与合规**:提供一体化智慧安全管理体系,保障企业数据安全[5](@ref)。\\n\\n### 腾讯云的市场地位\\n\\n腾讯云在中国公有云服务市场中保持较强的竞争力和市场地位。根据国际数据公司(IDC)的报告,腾讯云在2023年中国大数据平台公有云市场份额为14.4%,相比2022年的6.1%大幅增长136%,是主要厂商市场份额唯一增长的公司[8](@ref)。\\n\\n### 腾讯云的竞争对手\\n\\n腾讯云的主要竞争对手包括阿里云、华为云、京东云等公司。这些公司均致力于提供各类云计算服务,通过不断创新和提升服务质量,争夺市场份额[14](@ref)。\\n\\n腾讯云凭借其在云计算领域的深厚积累和创新能力,已经成为中国企业出海和全球市场拓展的重要支持。"},"FinishReason": "stop"}],"Replaces": [{"Id": "0","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_2_ae23e0f3-be95-4cfd-9e1b-84375c57f9da.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=18853bb5d2a37cea7992ebac9f5b9a68eb62d6b1","JumpUrl": "http://qcloud.ke.qq.com/"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_5_1adbbd1f-9126-43cc-bd3e-7713716e6ff5.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=2d620f1744c5438fb0861b5a0c7577bd7d735932","JumpUrl": "https://www.51pptmoban.com/keji/5996.html"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_6_cef95a00-7504-4acc-ac07-4eac63f36337.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=3778658d44e8ea7f548570ab6a24d398b8b807c3","JumpUrl": "https://www.slidestalk.com/CloudCommunity/Tencent_Cloud_IoT_Platform_Intro"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_3_4acf8324-707d-4a29-870c-41371e92c7a1.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=4d51c0352ad7e75b84ab1e343c322630e6deddd1","JumpUrl": "https://www.slidestalk.com/CloudCommunity/Tencent_Cloud_IoT_Platform_Intro"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_4_c3fa15d2-db73-4a3a-b4e3-6adc1fa1cd77.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=14b17cd98d6e8905ac2a0eacfda5825c9d692763","JumpUrl": "https://www.shangyun51.com/productdetail?id=2833"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_8_3cf77218-90b9-4755-b413-39d5f45d3cee.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=409997a601e0caa510b2d762e90a39df8dad905b","JumpUrl": "https://www.wgppt.com/82960.html"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_7_12d4c93a-51e7-40c3-910f-a56f77a4af31.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887726%3B1727751786&q-key-time=1726887726%3B1727751786&q-header-list=&q-url-param-list=&q-signature=308091807e31670c936c57663a25275e3e104252","JumpUrl": "https://www.rrppt.com/ppt/19103.html"},{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cc9bdb64577d5e894ad226b36f13363c_9_1d557bd1-d69b-4c61-b83e-21865a7544c4.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887725%3B1727751785&q-key-time=1726887725%3B1727751785&q-header-list=&q-url-param-list=&q-signature=4765162127a05293af7a7fae3fe372c5670794b9","JumpUrl": "https://wecityx.tencent.com/app/lab/articles/202446"}]}],"Created": 1726887805,"Id": "4a614944-dc12-40a2-8369-00cb4b8c5e27","Usage": {"PromptTokens": 3,"CompletionTokens": 318,"TotalTokens": 321}}}
BOX 型流式输出样例
输入示例
POST / HTTP/1.1Host: hunyuan.tencentcloudapi.comContent-Type: application/jsonX-TC-Action: ChatCompletions<公共请求参数>{"Model": "hunyuan-turbo","Stream": true,"EnableEnhancement": true,"EnableMultimedia": true,"Messages": [{"Role": "user","Content": "介绍一下腾讯云"}]}
输出示例
{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"[](@replace=0)\\n"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":8,"TotalTokens":11}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":""},"FinishReason":""}],"Replaces":[{"Id":"0","Multimedia":[{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_1_08d49415-8473-4f9c-97db-b6baea370693.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884897%3B1727748957&q-key-time=1726884897%3B1727748957&q-header-list=&q-url-param-list=&q-signature=8205898518471551a68cb83671b238a93a76dc99","JumpUrl":"http://qcloud.ke.qq.com/"},{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_6_1b530782-05bc-42d5-9976-b837c37b0bf3.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884897%3B1727748957&q-key-time=1726884897%3B1727748957&q-header-list=&q-url-param-list=&q-signature=28af3026d3dab08bb3d8f43aa59bf54e94d4106a","JumpUrl":"https://www.sohu.com/na/431142031_313745"},{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_3_6816cdd6-5650-4325-acc9-91c8e5d58097.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884897%3B1727748957&q-key-time=1726884897%3B1727748957&q-header-list=&q-url-param-list=&q-signature=cdceb68aad759a5f3ce3f15c16899449998cfae6","JumpUrl":"https://www.slidestalk.com/CloudCommunity/Tencent_Cloud_IoT_Platform_Intro"},{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_2_3c11bab7-b605-4826-973f-c87a652ddce3.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884898%3B1727748958&q-key-time=1726884898%3B1727748958&q-header-list=&q-url-param-list=&q-signature=813e79a0f022f48aa6571074c78fc071a06a8d40","JumpUrl":"https://www.slidestalk.com/CloudCommunity/Tencent_Cloud_IoT_Platform_Intro"},{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_9_bd6fcdb7-240e-417a-9a10-de4ca8f234a0.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884898%3B1727748958&q-key-time=1726884898%3B1727748958&q-header-list=&q-url-param-list=&q-signature=62f41773b924d6fab9014da6e9b0fda44a83b9dc","JumpUrl":"https://www.modb.pro/doc/2448"},{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_4_9739f11e-0efa-456c-b228-e23391e4a986.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884898%3B1727748958&q-key-time=1726884898%3B1727748958&q-header-list=&q-url-param-list=&q-signature=031032131bf955da9e86e62a8807bb3a6c91cc08","JumpUrl":"https://cloud.tencent.com/act/enterprise/center"},{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/c96c38dc0960c976cb3e7101a88452f1_8_424b29ae-2756-421d-9df2-a1b81cb1ff18.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726884897%3B1727748957&q-key-time=1726884897%3B1727748957&q-header-list=&q-url-param-list=&q-signature=d909cf2fd27e2285bf758271a660bbe7401a48b7","JumpUrl":"https://www.slidestalk.com/CloudCommunity/Tencent_Cloud_IoT_Platform_Intro"}]}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":8,"TotalTokens":11}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"腾讯"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":9,"TotalTokens":12}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"云"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":10,"TotalTokens":13}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"是"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":11,"TotalTokens":14}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"腾讯"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":12,"TotalTokens":15}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"公司"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":13,"TotalTokens":16}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"推出的"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":14,"TotalTokens":17}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"云端"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":15,"TotalTokens":18}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"运算"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":16,"TotalTokens":19}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"服务"},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":17,"TotalTokens":20}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":","},"FinishReason":""}],"Created":1726884963,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":18,"TotalTokens":21}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"提供"},"FinishReason":""}],"Created":1726884964,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":19,"TotalTokens":22}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"全球"},"FinishReason":""}],"Created":1726884964,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":20,"TotalTokens":23}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"领先的"},"FinishReason":""}],"Created":1726884964,"Id":"0b744c09-3cf9-478a-92a9-e8e4f45d81ef","Usage":{"PromptTokens":3,"CompletionTokens":21,"TotalTokens":24}}......
图文混排型非流式样例
输入示例
POST / HTTP/1.1Host: hunyuan.tencentcloudapi.comContent-Type: application/jsonX-TC-Action: ChatCompletions<公共请求参数>{"Model": "hunyuan-turbo","EnableEnhancement": true,"EnableMultimedia": true,"Messages": [{"Role": "user","Content": "国庆旅游目的地推荐"}]}
输出示例
{"Response": {"RequestId": "c2639ffe-b4a3-469a-b6e1-6ca5b3bd932c","Note": "以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices": [{"Message": {"Role": "assistant","Content": "国庆长假是旅游的好时机,许多地方都呈现出最美的秋色。以下是一些推荐的国庆旅游目的地,这些地方不仅风景优美,还能让你感受到不同的文化和自然奇观。\\n\\n1. **喀纳斯**\\n 喀纳斯位于新疆维吾尔自治区阿勒泰地区布尔津县,被誉为“中国十大秋景之首”。这里的秋天有蓝天、白云、冰峰、雪峙、森林、草甸、河流等元素交织在一起,形成了既有北国风光的雄浑,又有江南山水娇秀的绝美画卷[1](@ref)。\\n\\n \\n[](@replace=0)\\n2. **额济纳**\\n 额济纳位于内蒙古自治区阿拉善盟额济纳旗,这里的胡杨林在秋天披上了金色的外衣,形成了一片壮丽的金黄林海。额济纳的胡杨林和居延海的日出日落景象非常壮观,被誉为“活着千年不死,死后千年不倒,倒后千年不腐”的神奇树木[1](@ref)。\\n\\n \\n[](@replace=1)\\n3. **呼伦贝尔阿尔山**\\n 阿尔山位于内蒙古自治区呼伦贝尔市扎兰屯市,这里的秋天山川湖泊开始变得五彩斑斓。落叶松、白桦树等树木错杂交织,形成了如油画般的绚丽景象[1](@ref)。\\n\\n \\n[](@replace=2)\\n4. **九寨沟**\\n 九寨沟位于四川省阿坝藏族羌族自治州九寨沟县漳扎镇,被誉为“人间仙境”和“童话世界”。秋天的九寨沟湖畔树木金黄火红,湖泊如翡翠般镶嵌其间,展现出童话般的天真自然[1](@ref)。\\n\\n \\n[](@replace=3)\\n5. **稻城亚丁**\\n 稻城亚丁位于四川省甘孜藏族自治州稻城县,被誉为“金色的童话”。这里的秋天树叶开始变黄、变红,层林尽染,湖泊更加清澈碧蓝,雪山在阳光下更显巍峨壮丽[1](@ref)。\\n\\n \\n[](@replace=4)\\n6. **光雾山**\\n 光雾山位于四川省巴中市南江县,被誉为“中国红叶第一山”和“亚洲最长红毯”。红叶的色彩层次丰富,从蓝绿渐变到橙黄,再到红色,宛如一幅浓墨重彩的油画[1](@ref)。\\n\\n \\n[](@replace=5)\\n7. **桂林**\\n 桂林位于广西壮族自治区桂林市阳朔县,这里的山水甲天下,秋天的桂林群山环绕,峰峦叠嶂,山间树木换上了五彩斑斓的新装,红的枫叶、黄的银杏、绿的松柏,各种颜色交织在一起,为桂林的山水增添了丰富的层次与立体感[1](@ref)。\\n\\n \\n[](@replace=6)\\n8. **张家界**\\n 张家界位于湖南省张家界市武陵源区,这里的秋天层林尽染,五颜六色的树木将石峰装扮得风情万种,宛如一幅活了的水墨秋色画卷[1](@ref)。\\n\\n \\n[](@replace=7)\\n9. **杭州**\\n 杭州位于浙江省杭州市,这里的西湖美景四季不同,而秋天则以其独特的韵味吸引着无数游客。桂花飘香、枫叶如火,再加上古镇水乡的韵味,让杭州成为了秋天旅游的理想之地[4](@ref)。\\n\\n \\n[](@replace=8)\\n10. **西安**\\n 西安位于陕西省西安市,这座见证了中国数千年文明的城市,拥有丰富的历史遗迹。兵马俑、大雁塔、古城墙……每一处都是历史的缩影[4](@ref)。\\n\\n \\n[](@replace=9)\\n这些目的地不仅风景如画,还能让你在国庆期间体验到不同的文化和自然奇观,希望你能选择一个心仪的地方,度过一个愉快的国庆假期!"},"FinishReason": "stop"}],"Replaces": [{"Id": "0","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_2_6a65e259-5a05-4983-b884-827b3e791ee4.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887913%3B1727751973&q-key-time=1726887913%3B1727751973&q-header-list=&q-url-param-list=&q-signature=2fbaabc9d8dd3a3d96f67b921906bb55ed5b5b76","JumpUrl": "http://travel.qunar.com/p-oi712891-kanasijingqu"}]},{"Id": "1","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_08ad6277-2a67-4940-a42f-4ba6c0176730.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887918%3B1727751978&q-key-time=1726887918%3B1727751978&q-header-list=&q-url-param-list=&q-signature=4d2511690ae18480786d3e3b4e3d3ed31ff7948a","JumpUrl": "http://travel.qunar.com/youji/7473390"}]},{"Id": "2","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_1_2db3442f-ed27-4963-a39a-c3c4af1da72c.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887921%3B1727751981&q-key-time=1726887921%3B1727751981&q-header-list=&q-url-param-list=&q-signature=2bfa56373f9c6c317bb199b2f5bbccb29a5e2a1b","JumpUrl": "http://c.aesly.com/book/providerIndex.action?iscenicid=1"}]},{"Id": "3","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_6f2635be-24e6-44f5-b05a-64bc6ea1c1e1.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887927%3B1727751987&q-key-time=1726887927%3B1727751987&q-header-list=&q-url-param-list=&q-signature=b3ab0aa7aeb08cbbd1cfb939ee7773af522f2da9","JumpUrl": "http://699pic.com/tupian-500819828.html"}]},{"Id": "4","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_6c55ce16-523f-4f1b-8151-bd61377514fa.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887930%3B1727751990&q-key-time=1726887930%3B1727751990&q-header-list=&q-url-param-list=&q-signature=1e7eadc619e0220b070e7f8bcb7f0dfaddcd97d5","JumpUrl": "http://699pic.com/tupian-500709764.html"}]},{"Id": "5","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_b7ee6a80-5ba5-4d34-9cd2-8fa3ce46b60e.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887934%3B1727751994&q-key-time=1726887934%3B1727751994&q-header-list=&q-url-param-list=&q-signature=9cfea0f58d2ac834fc787e2a72aa2a5554111080","JumpUrl": "http://699pic.com/tupian-500261055.html"}]},{"Id": "6","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_62c32639-ab3c-425e-b81d-90ebbd5d2511.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887938%3B1727751998&q-key-time=1726887938%3B1727751998&q-header-list=&q-url-param-list=&q-signature=23515ea04377e8df5e58797fe05220ba7009cf0a","JumpUrl": "https://travel.qunar.com/p-cs299801-guilin"}]},{"Id": "7","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_2_a952a556-e5b1-47b5-b84d-62d6d7017f9d.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887941%3B1727752001&q-key-time=1726887941%3B1727752001&q-header-list=&q-url-param-list=&q-signature=a9d00b2f9ee981a49bd3a0e7185557c94a36bc84","JumpUrl": "https://touch.go.qunar.com/300064"}]},{"Id": "8","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_b43dde18-62dd-4bdb-92bb-47c1facb7a8e.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887944%3B1727752004&q-key-time=1726887944%3B1727752004&q-header-list=&q-url-param-list=&q-signature=5731f6b5287bc3b3d2e228705986e98042ce7733","JumpUrl": "http://baike.so.com/doc/3989050-4185307.html"}]},{"Id": "9","Multimedia": [{"Type": "image","Url": "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/cd1df1d1d0673c37caba4397df0a9b79_0_f1f08ac4-10ee-4a7c-b7b1-ec9062a13539.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726887946%3B1727752006&q-key-time=1726887946%3B1727752006&q-header-list=&q-url-param-list=&q-signature=c8c888c9d21edc779ecc8ec4aba331d4a432a4d4","JumpUrl": "https://www.vjshi.com/watch/5111250.html"}]}],"Created": 1726888008,"Id": "c2639ffe-b4a3-469a-b6e1-6ca5b3bd932c","Usage": {"PromptTokens": 4,"CompletionTokens": 777,"TotalTokens": 781}}}
图文混排型流式样例
输入示例
POST / HTTP/1.1Host: hunyuan.tencentcloudapi.comContent-Type: application/jsonX-TC-Action: ChatCompletions<公共请求参数>{"Model": "hunyuan-turbo","Stream": true,"EnableEnhancement": true,"EnableMultimedia": true,"Messages": [{"Role": "user","Content": "国庆旅游目的地推荐"}]}
输出示例
{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"[](@replace=0)\\n"},"FinishReason":""}],"Created":1726834772,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":9,"TotalTokens":15}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"国庆节"},"FinishReason":""}],"Created":1726834772,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":11,"TotalTokens":17}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"是中国的"},"FinishReason":""}],"Created":1726834772,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":14,"TotalTokens":20}}............{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":""},"FinishReason":""}],"Replaces":[{"Id":"0","Multimedia":[{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/370b6ef83c7f2565f8840285960b63aa_2_93e682b5-3952-4c14-9106-5368d7ffd263.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726834720%3B1727698780&q-key-time=1726834720%3B1727698780&q-header-list=&q-url-param-list=&q-signature=423a3d8d0e7f662ec9ec154b0212ab1f43461569","JumpUrl":"http://travel.qunar.com/p-oi712891-kanasijingqu"}]}],"Created":1726834783,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":300,"TotalTokens":306}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"在"},"FinishReason":""}],"Created":1726834783,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":301,"TotalTokens":307}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"秋天"},"FinishReason":""}],"Created":1726834783,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":303,"TotalTokens":309}}............{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"[](@replace=1)\\n"},"FinishReason":""}],"Created":1726834784,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":361,"TotalTokens":367}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"3"},"FinishReason":""}],"Created":1726834784,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":362,"TotalTokens":368}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"."},"FinishReason":""}],"Created":1726834784,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":363,"TotalTokens":369}}............{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":""},"FinishReason":""}],"Replaces":[{"Id":"1","Multimedia":[{"Type":"image","Url":"https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/370b6ef83c7f2565f8840285960b63aa_0_d6e46be5-333d-4e3f-8d11-2fa156627af5.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1726834725%3B1727698785&q-key-time=1726834725%3B1727698785&q-header-list=&q-url-param-list=&q-signature=3477343bf0c4ace7e359bd1969df366f5ec168a4","JumpUrl":"http://www.iceandrock.cn/index.php/activity/deal/id/289/sid/1924.html"}]}],"Created":1726834786,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":407,"TotalTokens":413}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"金黄"},"FinishReason":""}],"Created":1726834786,"Id":"d8770443-b1fc-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":409,"TotalTokens":415}}............
音乐类流式样例
输入示例
POST / HTTP/1.1Host: hunyuan.tencentcloudapi.comContent-Type: application/jsonX-TC-Action: ChatCompletions<公共请求参数>{"Model": "hunyuan-turbo","Stream": true,"EnableEnhancement": true,"EnableMultimedia": true,"Messages": [{"Role": "user","Content": "周杰伦的叶惠美专辑"}]}
输出示例
{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"周杰伦"},"FinishReason":""}],"Created":1728718532,"Id":"c6538d25-d671-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":2,"TotalTokens":8}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"的"},"FinishReason":""}],"Created":1728718532,"Id":"c6538d25-d671-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":3,"TotalTokens":9}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"《"},"FinishReason":""}],"Created":1728718532,"Id":"c6538d25-d671-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":4,"TotalTokens":10}}............{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"。"},"FinishReason":""}],"Created":1728718537,"Id":"c6538d25-d671-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":473,"TotalTokens":479}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"\\n"},"FinishReason":""}],"Created":1728718537,"Id":"c6538d25-d671-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":474,"TotalTokens":480}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":"[](@replace=0)\\n"},"FinishReason":""}],"Created":1728718537,"Id":"c6538d25-d671-4031-b925-154ce2763be2","Usage":{"PromptTokens":6,"CompletionTokens":483,"TotalTokens":489}}............{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":""},"FinishReason":""}],"Replaces":[{"Id":"0","Multimedia":[{"Type":"album","Title":"叶惠美","Desc":"11首曲目","Ext":{},"Url":"http://y.gtimg.cn/music/photo_new/T002R120x120M000000MkMni19ClKG_5.jpg"},{"Type":"music","Url":"http://y.gtimg.cn/music/photo_new/T002R120x120M000000MkMni19ClKG","Title":"以父之名","Singer":"周杰伦","Ext":{"SongId":97771,"SongMid":"001n4C3p1yv0FU","Vip":1}},{"Type":"music","Url":"http://y.gtimg.cn/music/photo_new/T002R120x120M000000MkMni19ClKG_5.jpg","Title":"晴天","Singer":"周杰伦","Ext":{"SongId":97773,"SongMid":"0039MnYb0qxYhV","Vip":1}},{"Type":"music","Url":"http://y.gtimg.cn/music/photo_new/T002R120x120M000000MkMni19ClKG_5.jpg","Title":"东风破","Singer":"周杰伦","Ext":{"SongId":97775,"SongMid":"003uEbEr0jcW7c","Vip":1}},{"Type":"music","Url":"http://y.gtimg.cn/music/photo_new/T002R120x120M000000MkMni19ClKG_5.jpg","Title":"你听得到","Singer":"","Ext":{"SongId":5244390,"SongMid":"002elTc93yuXu2","Vip":1}}]}],"Created":1728718537,"Id":"c6538d25-d671-4324-934d-12e021165955","Usage":{"PromptTokens":6,"CompletionTokens":484,"TotalTokens":490}}{"Note":"以上内容为AI生成,不代表开发者立场,请勿删除或修改本标记","Choices":[{"Delta":{"Role":"assistant","Content":""},"FinishReason":"stop"}],"Created":1728718537,"Id":"c6538d25-d671-43e":{"PromptTokens":6,"CompletionTokens":485,"TotalTokens":491}}............
图片类业务处理代码样例
import json import re import types from tencentcloud.common import credential from tencentcloud.common.profile.client_profile import ClientProfile from tencentcloud.common.profile.http_profile import HttpProfile from tencentcloud.common.exception.tencent_cloud_sdk_exception import TencentCloudSDKException from tencentcloud.hunyuan.v20230901 import hunyuan_client, models # 占位符替换 def replace(data, content, stream): res = json.loads(data) if res.get('Choices') is not None: if stream: content += res['Choices'][0]['Delta']['Content'] else: content += res['Choices'][0]['Message']['Content'] if res.get('Replaces') is not None: def replace_placeholder(match): nums = re.search(match).group(1) tmp = "" for v in res['Replaces']: if v['Id'] == nums: for mu in v['Multimedia']: tmp = f"{tmp} [![{mu['Url']}]({mu['JumpUrl']})]" return tmp content = re.sub(lambda match: replace_placeholder(match.group(0)), content) return content # 这里的url和jumpUrl,可以替换成自己的默认地址 def replace_default(): url = 'https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/5429839bdd4aa19daeaf69d79cdd2993_4_7f33dde7-e73c-4bc1-a098-5fc2f655176b.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1728552476%3B1729416536&q-key-time=1728552476%3B1729416536&q-header-list=&q-url-param-list=&q-signature=e91c9ce28a61901f1f784a5c7a72560a321b1df1' jumpUrl = 'https://www.idctalk.com/tencentcloud.html' return f"[]" try: # 实例化一个认证对象,入参需要传入腾讯云账户 SecretId 和 SecretKey,此处还需注意密钥对的保密 # 代码泄露可能会导致 SecretId 和 SecretKey 泄露,并威胁账号下所有资源的安全性。以下代码示例仅供参考,建议采用更安全的方式来使用密钥,请参见:https://cloud.tencent.com/document/product/1278/85305 # 密钥可前往官网控制台 https://console.cloud.tencent.com/cam/capi 进行获取 cred = credential.Credential(SecretId, SecretKey) # 实例化一个http选项,可选的,没有特殊需求可以跳过 httpProfile = HttpProfile() httpProfile.endpoint = "hunyuan.tencentcloudapi.com" # 实例化一个client选项,可选的,没有特殊需求可以跳过 clientProfile = ClientProfile() clientProfile.httpProfile = httpProfile # 实例化要请求产品的client对象,clientProfile是可选的 client = hunyuan_client.HunyuanClient(cred, "", clientProfile) # 实例化一个请求对象,每个接口都会对应一个request对象 req = models.ChatCompletionsRequest() params = { "Model": "hunyuan-turbo", "Stream": True, "EnableMultimedia": True, # 多媒体开关 "Messages": [ { "Role": "user", "Content": "国庆旅游目的地推荐" } ] } req.from_json_string(json.dumps(params)) # 返回的resp是一个ChatCompletionsResponse的实例,与请求对象对应 resp = client.ChatCompletions(req) c = "" # 最终展示给用户的内容 pattern = r'\\[\\]\\(@replace=(\\d+)\\)' # 匹配多媒体占位符的正则表达式 re = re.compile(pattern) if isinstance(resp, types.GeneratorType): # 流式响应 for event in resp: c = replace(event['data'], c, True) print(c) else: # 非流式响应 c = replace(resp.to_json_string(), '', False) print(resp) # 处理有占位符但是没有replace信息的情况 c = re.sub(lambda match: replace_default(), c) print(c) except TencentCloudSDKException as err: print(err)
package main import ( "fmt" "regexp" "github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common" "github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common/errors" "github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common/json" "github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/common/profile" hunyuan "github.com/tencentcloud/tencentcloud-sdk-go/tencentcloud/hunyuan/v20230901" ) // pattern 匹配多媒体占位符的正则表达式 const pattern = `\\[\\]\\(@replace=(\\d+)\\)` func main() { credential := common.NewCredential(SecretId, SecretKey) // 实例化一个client选项,可选的,没有特殊需求可以跳过 cpf := profile.NewClientProfile() // 推荐使用北极星,相关指引可访问如下链接 // https://git.woa.com/tencentcloud-internal/tencentcloud-sdk-go#%E5%8C%97%E6%9E%81%E6%98%9F cpf.HttpProfile.Endpoint = "hunyuan.tencentcloudapi.com" // 实例化要请求产品的client对象,clientProfile是可选的 client, _ := hunyuan.NewClient(credential, "", cpf) // 实例化一个请求对象,每个接口都会对应一个request对象 request := hunyuan.NewChatCompletionsRequest() request.Model = common.StringPtr("hunyuan-turbo") request.Stream = common.BoolPtr(true) request.EnableMultimedia = common.BoolPtr(true) request.Messages = []*hunyuan.Message{ &hunyuan.Message{ Role: common.StringPtr("user"), Content: common.StringPtr("国庆旅游目的地推荐"), }, } response, err := client.ChatCompletions(request) if _, ok := err.(*errors.TencentCloudSDKError); ok { fmt.Printf("An API error has returned: %s", err) return } if err != nil { panic(err) } // 最终展示给用户的内容 c := "" if response.Response != nil { // 非流式响应 c = replace(*response.Response, c, false) fmt.Println(c) } else { // 流式响应 for event := range response.Events { res := hunyuan.ChatCompletionsResponseParams{} json.Unmarshal(event.Data, &res) c = replace(res, c, true) fmt.Println(c) } } // 处理有占位符但是没有replace信息的情况 re := regexp.MustCompile(pattern) c = re.ReplaceAllStringFunc(c, func(_ string) string { // 这里的url和jumpUrl,可以替换成自己的默认地址 url := "https://hunyuan-plugin-1258344706.cos.ap-nanjing.myqcloud.com/ai_search/bing_image/5429839bdd4aa19daeaf69d79cdd2993_4_7f33dde7-e73c-4bc1-a098-5fc2f655176b.jpg?q-sign-algorithm=sha1&q-ak=******************************************&q-sign-time=1728552476%3B1729416536&q-key-time=1728552476%3B1729416536&q-header-list=&q-url-param-list=&q-signature=e91c9ce28a61901f1f784a5c7a72560a321b1df1" jumpUrl := "https://www.idctalk.com/tencentcloud.html" return fmt.Sprintf("[]", url, jumpUrl) }) fmt.Println(c) } // replace 占位符替换 func replace(res hunyuan.ChatCompletionsResponseParams, content string, stream bool) string { if len(res.Choices) > 0 { if stream { content += *res.Choices[0].Delta.Content } else { content += *res.Choices[0].Message.Content } } re := regexp.MustCompile(pattern) if len(res.Replaces) > 0 { content = re.ReplaceAllStringFunc(content, func(match string) string { nums := re.FindStringSubmatch(match)[1] tmp := "" for _, v := range res.Replaces { if *v.Id == nums { for _, mu := range v.Multimedia { tmp = fmt.Sprintf("%s [](%s)", tmp, *mu.Url, *mu.JumpUrl) } } } return tmp }) } return content }