{"componentChunkName":"component---src-templates-acg-portal-new-template-tsx","path":"/umu0pb62c","result":{"data":{"markdownRemark":{"html":"

简介

\n

视频抽帧打标算子：按 all_keyframes 或 uniform 抽帧，逐帧过 RAM++（recognize-anything plus）打标，再按标签出现频次降序合并成一条视频级标签列表。

\n

功能描述

\n\n

算子参数

\n

输入

\n\n\n\n\n\n\n\n\n\n\n\n\n\n
输入含义
video视频输入数组，内容类型由 video_src_type 决定（本地/BOS 路径 / Base64 字符串 / bytes）
\n

输出

\n\n\n\n\n\n\n\n\n\n\n\n\n\n
输出含义
frame_tagslist<large_string>，视频级标签，按出现频次降序去重；输入为 null 或该行失败时为空列表
\n

参数

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
参数名称类型默认值描述
video_src_typestr\"video_url\"输入形式：video_url / video_base64 / video_binary
model_pathstr\"/opt/aihc/model\"权重根目录
model_namestr\"ram_plus_swin_large_14m.pth\"相对 model_path 的 RAM++ 权重文件名
frame_sampling_methodstr\"all_keyframes\"抽帧方式：all_keyframes / uniform
frame_numint3uniform 模式抽帧数，必须为正
input_sizeint384模型输入分辨率
max_framesint64单视频抽帧上限，<= 0 表示不限
batch_sizeint8打标微批大小，<= 1 时按 1 处理
rankint0多卡场景 worker 序号，设备取 cuda:<rank % 可见卡数>
\n

注意事项

\n\n

调用示例

\n\n
\n
\n
\n Python\n \n
\n
\n 
1from __future__ import annotations\n2\n3import os\n4\n5import daft\n6from daft import col\n7\n8from daft.aihc.common.udf import aihc_udf\n9from daft.aihc.functions.video.video_tagging_from_frames import VideoTaggingFromFrames\n10\n11os.environ.setdefault(\"BOS_ENDPOINT\", \"http://bj.bcebos.com\")\n12os.environ.setdefault(\"BOS_REGION\", \"bj\")\n13\n14if __name__ == \"__main__\":\n15    if os.getenv(\"DAFT_RUNNER\", \"native\") == \"ray\":\n16        import ray\n17        ray.init(dashboard_host=\"0.0.0.0\", ignore_reinit_error=True)\n18        daft.set_runner_ray()\n19    daft.set_execution_config(actor_udf_ready_timeout=6000, min_cpu_per_task=0)\n20\n21ds = daft.from_pydict({\"video\": [\"bos://your-bucket/sample.mp4\"]})\n22    ds = ds.with_column(\n23        \"frame_tags\",\n24        aihc_udf(\n25            VideoTaggingFromFrames,\n26            construct_args={\n27                \"video_src_type\": \"video_url\",\n28                \"model_path\": \"/path/to/models\",\n29                \"model_name\": \"ram_plus_swin_large_14m.pth\",\n30                \"frame_sampling_method\": \"uniform\",\n31                \"frame_num\": 3,\n32                \"batch_size\": 4,\n33            },\n34            num_cpus=1,\n35            num_gpus=1,\n36            concurrency=1,\n37            batch_size=1,\n38        )(col(\"video\")),\n39    )\n40    ds.show()
\n
\n
\n
\n ","fields":{"slug":"umu0pb62c","title":"视频帧标签","date":"2026-09-14","extractedHeadings":[]},"headings":[{"value":"简介","depth":2},{"value":"功能描述","depth":3},{"value":"算子参数","depth":2},{"value":"输入","depth":3},{"value":"输出","depth":3},{"value":"参数","depth":3},{"value":"注意事项","depth":2},{"value":"调用示例","depth":2}]}},"pageContext":{"isCreatedByStatefulCreatePages":false,"slug":"umu0pb62c","prev":{"id":"xmu0pfbjc","name":"视频目标分割","path":"xmu0pfbjc","filePath":"操作指南/AI数据处理/算子列表/视频/视频目标分割.md","seo":null,"parentIds":["ilib2qygp","Ymo88m8hi","Imob3m6so","6mpawyry0"],"parents":[{"id":"ilib2qygp","documentId":"bfa43a8b-968a-41a1-8c9d-906507eeaed9","name":"操作指南","repoName":"AIHC","filePath":"操作指南","disabled":false,"path":"ilib2qygp","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":null,"solutionTag":null,"solutionColor":null},{"id":"Ymo88m8hi","documentId":"c8cb5e38-f8c5-40f4-a424-b0c7895f0c0a","name":"AI数据处理","repoName":"AIHC","filePath":"操作指南/AI数据处理","disabled":false,"path":"Ymo88m8hi","lastMergeTime":"2026-04-21 14:23:10","isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null},{"id":"Imob3m6so","documentId":"fe548e34-6659-4ff5-86f6-eee2c43aec90","name":"算子列表","repoName":"AIHC","filePath":"操作指南/AI数据处理/算子列表","disabled":false,"path":"Imob3m6so","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null},{"id":"6mpawyry0","documentId":"3428d02c-e287-45b8-9d16-5a7b20881dd4","name":"视频","repoName":"AIHC","filePath":"操作指南/AI数据处理/算子列表/视频","disabled":false,"path":"6mpawyry0","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null}]},"next":{"id":"smohxoure","name":"AIHC-Daft算子开发使用指南","path":"smohxoure","filePath":"操作指南/AI数据处理/AIHC-Daft算子开发使用指南.md","seo":null,"parentIds":["ilib2qygp","Ymo88m8hi"],"parents":[{"id":"ilib2qygp","documentId":"bfa43a8b-968a-41a1-8c9d-906507eeaed9","name":"操作指南","repoName":"AIHC","filePath":"操作指南","disabled":false,"path":"ilib2qygp","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":null,"solutionTag":null,"solutionColor":null},{"id":"Ymo88m8hi","documentId":"c8cb5e38-f8c5-40f4-a424-b0c7895f0c0a","name":"AI数据处理","repoName":"AIHC","filePath":"操作指南/AI数据处理","disabled":false,"path":"Ymo88m8hi","lastMergeTime":"2026-04-21 14:23:10","isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null}]},"parents":[{"id":"ilib2qygp","documentId":"bfa43a8b-968a-41a1-8c9d-906507eeaed9","name":"操作指南","repoName":"AIHC","filePath":"操作指南","disabled":false,"path":"ilib2qygp","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":null,"solutionTag":null,"solutionColor":null},{"id":"Ymo88m8hi","documentId":"c8cb5e38-f8c5-40f4-a424-b0c7895f0c0a","name":"AI数据处理","repoName":"AIHC","filePath":"操作指南/AI数据处理","disabled":false,"path":"Ymo88m8hi","lastMergeTime":"2026-04-21 14:23:10","isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null},{"id":"Imob3m6so","documentId":"fe548e34-6659-4ff5-86f6-eee2c43aec90","name":"算子列表","repoName":"AIHC","filePath":"操作指南/AI数据处理/算子列表","disabled":false,"path":"Imob3m6so","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null},{"id":"6mpawyry0","documentId":"3428d02c-e287-45b8-9d16-5a7b20881dd4","name":"视频","repoName":"AIHC","filePath":"操作指南/AI数据处理/算子列表/视频","disabled":false,"path":"6mpawyry0","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":"","solutionTag":null,"solutionColor":null}],"specificSeo":null}}}