{"componentChunkName":"component---src-templates-acg-portal-new-template-tsx","path":"/Mmnssc24z","result":{"data":{"markdownRemark":{"html":"<p>技能评测可完成技能评测数据集管理、技能评测任务创建、评测结果查看与比对等全流程操作，通过标准化评测流程实现技能效果的量化评估，筛选最优技能版本发布，保障发布技能的效果质量。</p>\n<h1 id=\"评测数据集管理\"><a href=\"#%E8%AF%84%E6%B5%8B%E6%95%B0%E6%8D%AE%E9%9B%86%E7%AE%A1%E7%90%86\" aria-label=\"评测数据集管理 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>评测数据集管理</h1>\n<p>技能评测需要使用评测数据集。</p>\n<h2 id=\"创建评测数据集\"><a href=\"#%E5%88%9B%E5%BB%BA%E8%AF%84%E6%B5%8B%E6%95%B0%E6%8D%AE%E9%9B%86\" aria-label=\"创建评测数据集 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>创建评测数据集</h2>\n<p>选择“数据>数据集管理”，点击【创建数据集】。</p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc1_e470d17.png\" alt=\"jnpc1.png\"></p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc2_94017aa.png\" alt=\"jnpc2.png\"></p>\n<ul>\n<li><strong>数据集用途</strong>选择“技能评测”</li>\n<li>填写<strong>数据集名称</strong></li>\n<li><strong>数据集分类</strong>仅可选择视频类，对视频进行正负样本分类标注</li>\n<li>可为数据集添加<strong>数据集标签</strong></li>\n<li>支持添加<strong>电子围栏</strong>，添加后可在标注时被使用</li>\n</ul>\n<h2 id=\"导入数据\"><a href=\"#%E5%AF%BC%E5%85%A5%E6%95%B0%E6%8D%AE\" aria-label=\"导入数据 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>导入数据</h2>\n<p>在「数据集详情」页，点击【导入数据】，为评测数据集添加视频数据。</p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc5_183c8f9.png\" alt=\"jnpc5.png\"></p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc3_d11f450.png\" alt=\"jnpc3.png\"></p>\n<ul>\n<li><strong>数据类型</strong>仅可选择视频类型</li>\n<li>可上传<strong>原始视频</strong>，勾选<strong>标注信息</strong>后，仅可上传压缩包</li>\n<li>\n<p>开启<strong>数据处理</strong>后，数据集将只导入处理了完成后的数据。数据处理支持多选，可同时选择视频切片和视频去重</p>\n<ul>\n<li>视频切片：将视频切分为固定时长的短视频，高级参数只包含视频切片时长，默认值为30s，支持输入1-3600的整数</li>\n<li>视频去重：将视频进行特征比对并去掉重复性较高的视频，高级参数为视频去重帧间隔和视频去重Hash距离；视频去重帧间隔默认参数为50帧，支持输入1-100的整数；视频去重Hash距离默认值为5，支持输入1-16的整数</li>\n</ul>\n</li>\n</ul>\n<h2 id=\"标注评测数据\"><a href=\"#%E6%A0%87%E6%B3%A8%E8%AF%84%E6%B5%8B%E6%95%B0%E6%8D%AE\" aria-label=\"标注评测数据 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>标注评测数据</h2>\n<p>点击导入的视频数据，进入标注详情页面。</br></p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc4_7d50ee0.png\" alt=\"jnpc4.png\"></p>\n<ul>\n<li>\n<p>可将样本标注为“正样本”或“负样本”</p>\n<ul>\n<li>正样本：与真实目标类别匹配的样本，在技能评测中，指在该技能逻辑下应当产生结果的数据</li>\n<li>负样本：与真实目标类别不匹配的样本，在技能评测中，指在该技能逻辑下不应当产生结果的数据</li>\n</ul>\n</li>\n<li>\n<p>电子围栏标注：绘制多边形电子围栏，圈定视频中的目标区域，电子围栏需配置目标占比和选区范围</p>\n<ul>\n<li>目标占比：指目标在电子围栏中的部分占目标总体的比例，当目标进入电子围栏占比超过所设置占比值时，系统即产生报警，反之将不产生报警。填写时，支持输入0.00-1.00的数字。</li>\n<li>选取范围：目前仅支持正选</li>\n</ul>\n</li>\n</ul>\n<h2 id=\"发布评测数据集\"><a href=\"#%E5%8F%91%E5%B8%83%E8%AF%84%E6%B5%8B%E6%95%B0%E6%8D%AE%E9%9B%86\" aria-label=\"发布评测数据集 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>发布评测数据集</h2>\n<p>标注完所有数据后，点击【发布】，发布后的评测数据集才可用于技能评测。</p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc6_b1c8dae.png\" alt=\"jnpc6.png\"></p>\n<h1 id=\"创建评测任务\"><a href=\"#%E5%88%9B%E5%BB%BA%E8%AF%84%E6%B5%8B%E4%BB%BB%E5%8A%A1\" aria-label=\"创建评测任务 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>创建评测任务</h1>\n<p>选择“技能>技能评测”，进入「技能评测」页面。</br></p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc7_9cc459c.png\" alt=\"jnpc7.png\"></p>\n<p>点击【创建评测任务】。</p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc8_f6f3c39.png\" alt=\"jnpc8.png\"></p>\n<ul>\n<li>填写<strong>评测任务名称</strong></li>\n<li><strong>评测类型</strong>默认效果评测</li>\n<li>选择已发布的<strong>评测数据集</strong></li>\n<li>选择<strong>评测技能</strong>，可选择单个技能查看评测结果报告，也可选择多个技能或技能的多个版本，查看评测结果对比</li>\n</ul>\n<p>点击【创建】后，开始执行评测任务，等待评测任务完成。</p>\n<h1 id=\"查看评测报告\"><a href=\"#%E6%9F%A5%E7%9C%8B%E8%AF%84%E6%B5%8B%E6%8A%A5%E5%91%8A\" aria-label=\"查看评测报告 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>查看评测报告</h1>\n<p>选择“评测成功”的评测任务，点击【查看报告】，进入任务详情页。</p>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc9_4a5f421.png\" alt=\"jnpc9.png\"></p>\n<h2 id=\"技能评测指标\"><a href=\"#%E6%8A%80%E8%83%BD%E8%AF%84%E6%B5%8B%E6%8C%87%E6%A0%87\" aria-label=\"技能评测指标 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>技能评测指标</h2>\n<ul>\n<li>评测样本数：评测数据集里的样本数量</li>\n<li>推理总帧数：对评测数据集中的样本进行抽帧后，模型成功返回结果的图片总数</li>\n<li>技能结果总数：技能运行后，符合技能编排逻辑输出结果的数量</li>\n<li>TP：真正例，True Positive，模型预测为正例，且实际确实为正例</li>\n<li>FP：假正例，False Positive，模型预测为正例，但实际是负例</li>\n<li>TN：真负例，True Negative，模型预测为负例，且实际确实为负例</li>\n<li>FN：假负例，False Negative，模型预测为负例，但实际是正例</li>\n<li>召回率：实际为正类的样本中被模型正确预测为正类的比例，计算公式为 TP/(TP+FN)</li>\n<li>准确率：模型正确预测的样本数占总样本数的比例，计算公式为 (TP+TN)/(TP+TN+FP+FN)</li>\n<li>精确率：模型预测为正类的样本中实际为正类的比例，计算公式为 TP/(TP+FP)</li>\n</ul>\n<h2 id=\"样本分析\"><a href=\"#%E6%A0%B7%E6%9C%AC%E5%88%86%E6%9E%90\" aria-label=\"样本分析 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>样本分析</h2>\n<p>选择创建评测任务时选择的技能，对比每个样本的自动评测结果：</br></p>\n<ul>\n<li>数据集中标注为正样本，技能评测运行成功后技能结果数量大于0，则自动评测结果为TP</li>\n<li>数据集中标注为负样本，技能评测运行成功后技能结果数量大于0，则自动评测结果为FP</li>\n<li>数据集中标注为正样本，技能评测运行成功后技能结果数量等于0，则自动评测结果为FN</li>\n<li>数据集中标注为负样本，技能评测运行成功后技能结果数量等于0，则自动评测结果为TN</li>\n</ul>\n<h1 id=\"评测结果对比\"><a href=\"#%E8%AF%84%E6%B5%8B%E7%BB%93%E6%9E%9C%E5%AF%B9%E6%AF%94\" aria-label=\"评测结果对比 permalink\" class=\"anchor\"><svg aria-hidden=\"true\" focusable=\"false\" height=\"16\" version=\"1.1\" viewBox=\"0 0 16 16\" width=\"16\"><path fill-rule=\"evenodd\" d=\"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z\"></path></svg></a>评测结果对比</h1>\n<ol>\n<li>选择评测数据集</li>\n<li>选择该数据集已完成技能评测任务所使用的技能及技能版本</li>\n<li>点击【生成评测对比报告】，可<strong>跨任务对比</strong>不同技能或技能版本的评测结果</li>\n</ol>\n<p><img src=\"https://bce.bdstatic.com/doc/WSMP/YIJIAN_PUBLIC/jnpc10_cada2f3.png\" alt=\"jnpc10.png\"></p>","fields":{"slug":"Mmnssc24z","title":"技能效果评测","date":"2026-04-10","extractedHeadings":[]},"headings":[{"value":"评测数据集管理","depth":1},{"value":"创建评测数据集","depth":2},{"value":"导入数据","depth":2},{"value":"标注评测数据","depth":2},{"value":"发布评测数据集","depth":2},{"value":"创建评测任务","depth":1},{"value":"查看评测报告","depth":1},{"value":"技能评测指标","depth":2},{"value":"样本分析","depth":2},{"value":"评测结果对比","depth":1}]}},"pageContext":{"isCreatedByStatefulCreatePages":false,"slug":"Mmnssc24z","prev":{"id":"mmnssc2g0","name":"技能版本管理","path":"mmnssc2g0","filePath":"技能开发/技能生产/技能版本管理.md","seo":null,"parentIds":["Gmnssc1j2","vmnssc229"],"parents":[{"id":"Gmnssc1j2","documentId":"18e320c3-44c6-4431-b55b-600497aabccd","name":"技能开发","repoName":"yijian","filePath":"技能开发","disabled":false,"path":"Gmnssc1j2","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":""},{"id":"vmnssc229","documentId":"c47b2338-47af-493b-8a98-2338a123abc4","name":"技能生产","repoName":"yijian","filePath":"技能开发/技能生产","disabled":false,"path":"vmnssc229","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":""}]},"next":{"id":"zmnssc2bn","name":"发布技能API","path":"zmnssc2bn","filePath":"技能开发/技能生产/发布技能API.md","seo":null,"parentIds":["Gmnssc1j2","vmnssc229"],"parents":[{"id":"Gmnssc1j2","documentId":"18e320c3-44c6-4431-b55b-600497aabccd","name":"技能开发","repoName":"yijian","filePath":"技能开发","disabled":false,"path":"Gmnssc1j2","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":""},{"id":"vmnssc229","documentId":"c47b2338-47af-493b-8a98-2338a123abc4","name":"技能生产","repoName":"yijian","filePath":"技能开发/技能生产","disabled":false,"path":"vmnssc229","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":""}]},"parents":[{"id":"Gmnssc1j2","documentId":"18e320c3-44c6-4431-b55b-600497aabccd","name":"技能开发","repoName":"yijian","filePath":"技能开发","disabled":false,"path":"Gmnssc1j2","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":""},{"id":"vmnssc229","documentId":"c47b2338-47af-493b-8a98-2338a123abc4","name":"技能生产","repoName":"yijian","filePath":"技能开发/技能生产","disabled":false,"path":"vmnssc229","lastMergeTime":null,"isApiDoc":null,"httpMethod":null,"seo":null,"sourceOrgName":null,"sourceRepoName":null,"sourceDocumentId":""}],"specificSeo":null}}}