DeepSeek Harness plugin

dsh-vqa-agent

vqa_ask 双模型视觉问答插件:主模型调用 vqa_ask 向视觉模型提问(图片字节真实送达),UI 实时展示"主模型提问 → 视觉模型回答"的 QA 过程,并在主设置提供多模态视觉模型选择页。

Jump to install

Source facts

Repository
jypjypjypjyp/dsh-vqa-agent
Latest update
Aug 17, 2026
Category
Vision & Multimodal
GitHub stars
2
Format
plugin
Catalog evidence
Upstream dsh.bundle evidence
Evidence path
package.json#dsh.bundle
Checked against
0.1.0-rc.8
Upstream check date
2026-08-20

This evidence comes from the upstream catalog. This site has not installed, run, or security-reviewed the plugin.

Install

Start with a prompt that asks an agent to review the GitHub repository and source. Switch to the command if you want to install it yourself.

Copy this prompt into DSH, Codex, or another agent and ask it to review the GitHub repository and source first.

Do not install or run any commands yet. Read this plugin's GitHub repository, README, and relevant source code. Then answer the questions below clearly and directly so I can decide whether it fits my needs:

1. What is this plugin, and what problem does it solve?
2. Who is it for, and what are its typical use cases?
3. How is it used after installation? Include one minimal example.
4. What known limitations or privacy, security, compatibility, or maintenance risks does it have?
5. Give a clear recommendation: recommend, conditionally recommend, or do not recommend, with reasons.

Distinguish statements documented by the repository, inferences from source code, and unknowns. If evidence is insufficient, say so explicitly. Do not guess or simply repeat the README.

GitHub: https://github.com/jypjypjypjyp/dsh-vqa-agent
Plugin: dsh-vqa-agent
Author: jypjypjypjyp

Check the source files

Read the README and other files from this plugin directory before installing.

File explorer2 files
README.mdSource · read only

dsh-vqa-agent

DSH Web 插件(官方 bundle 形态):主模型调用 vqa_ask视觉模型提问,图片字节真实送达视觉模型,UI 实时展示「主模型提问 → 视觉模型回答」的 QA 过程;主设置提供多模态视觉模型选择页。

结构

package.json              # dsh.bundle.patch + dsh.client.platform=web + exports
cordis.patch.yml          # 向 web 组合挂载本插件(Node half)
.dsh-plugin/index.mjs     # Node half:注册 vqa_ask 工具 + webServer 路由
.dsh-plugin/client/index.mjs  # 浏览器 half 源码(esbuild 打包)
.dsh-plugin/client.js     # 构建产物(手改禁止;改源码后 node scripts/build-client.mjs)
scripts/build-client.mjs  # esbuild 构建器(--check 做新鲜度门禁)

构建

npm i -D esbuild          # 首次
node scripts/build-client.mjs   # 生成 .dsh-plugin/client.js
node scripts/build-client.mjs --check   # 校验产物与源码一致

安装到 DSH Web profile

1. 在 /Users/a1234/.dsh/profiles/web/package.json: - dependencies 增加 "dsh-vqa-agent": "file:<本仓库路径>" - dsh.profile.bundles 增加 "dsh-vqa-agent" 2. 在 profile 目录执行 pnpm install(或 pnpm add dsh-vqa-agent@file:<路径>)。 3. 重启 web 服务并刷新页面。

也可以把本仓库推到 GitHub/GitLab 后用 git 依赖(参考 whale-girl 的 github:vlln/whale-girl#main)。

通信契约

  • Node ↔ 浏览器:webServer 路由(全部 POST JSON):

- /dsh-vqa-agent/exchange {callId} — 单次问答快照(轮询,流式) - /dsh-vqa-agent/image {convKey} — 图片 dataURL(每会话拉一次) - /dsh-vqa-agent/transcript {} — 全部会话 QA 记录 - /dsh-vqa-agent/settings {} — 当前选择 + 多模态模型列表 - /dsh-vqa-agent/set-model {provider, model} — 设置页选择视觉模型

  • 浏览器 half 由 __ModuleLoader__.load({id, factory}) 挂载,React 经种子词 require("react") 解析(esbuild --external:react),样式直接注入 DOM。

功能

  • 工具 vqa_ask(image, question, model?, provider?, maxTokens?):读文件 → 魔数嗅探真实格式(PNG/JPEG/WebP/GIF,不信扩展名)→ attachments 生成引用 → 图片发给视觉模型 → 流式回答;同图追问自动带上下文。
  • 工具卡片(tool.call.toolview key vqa_ask):主模型提问气泡 + 视觉模型回答气泡 + 缩略图 + 状态徽标(固定深色底,明暗主题均清晰)。
  • Run 面板(tool.view.cordis key self):「双模型 QA 过程」总览。
  • 设置页(settings.section id vqa-vision):从所有提供方中选多模态模型作视觉模型,选择通过 settings 服务写入 settings.yamlvqa: {provider, model} 分节持久保存,重启后仍记住。

默认视觉模型解析顺序

设置页选择 → VQA 配置(settings.yamlvqa: {provider, model})→ 内置默认 momenta-gateway / qwen3.7-plus