Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 在llm-model.json里面新增模型,重载LLM之后会被恢复成原来的版本 #1111

Open
wang149876 opened this issue Feb 21, 2025 · 2 comments
Labels
bug? Bug或Bug修复相关

Comments

@wang149876
Copy link

消息平台适配器

aiocqhttp(使用 OneBot 协议接入的)

运行环境

v3.4.8、Ubuntu、X86、Docker

异常情况

已经在llm-models.json中增加一个叫deepseek-r1-32b的模型,但是每次重载LLM之后就直接被删了,我记得更新之前是正常的。

[02-21 08:30:48.248] manager.py (70) - [INFO] : 初始化平台适配器 0: aiocqhttp
[02-21 08:30:49.467] show_notes.py (26) - [INFO] : 当前版本:v3.4.8
[02-21 08:30:49.523] app.py (168) - [INFO] : =======================================
[02-21 08:30:49.523] app.py (168) - [INFO] : ✨ 您可通过以下方式访问管理面板
[02-21 08:30:49.524] app.py (168) - [INFO] :
[02-21 08:30:49.524] app.py (168) - [INFO] : 🏠 本地地址:http://127.0.0.1:5300/
[02-21 08:30:49.525] app.py (168) - [INFO] :
[02-21 08:30:49.526] app.py (168) - [INFO] : 📌 如果您在容器中运行此程序,请确保容器的 5300 端口已对外暴露
[02-21 08:30:49.526] app.py (168) - [INFO] : 🔗 若要使用公网地址访问,请阅读以下须知
[02-21 08:30:49.526] app.py (168) - [INFO] : 1. 公网地址仅供参考,请以您的主机公网 IP 为准;
[02-21 08:30:49.527] app.py (168) - [INFO] : 2. 要使用公网地址访问,请确保您的主机具有公网 IP,并且系统防火墙已放行 5300 端口;
[02-21 08:30:49.527] app.py (168) - [INFO] :
[02-21 08:30:49.527] app.py (168) - [INFO] : 🤯 WebUI 仍处于 Beta 测试阶段,如有问题或建议请反馈到 https://github.com/RockChinQ/LangBot/issues
[02-21 08:30:49.528] app.py (168) - [INFO] : =======================================
[02-21 08:31:06.394] controller.py (189) - [ERROR] : 处理请求时出错 query_id=0 stage=PreProcessor : 无法确定模型 deepseek-r1-32b 的信息,请在元数据中配置
[02-21 08:42:40.231] app.py (201) - [INFO] : 执行热重载 scope=provider
[02-21 08:43:57.274] app.py (201) - [INFO] : 执行热重载 scope=provider
[02-21 08:46:13.672] app.py (201) - [INFO] : 执行热重载 scope=provider
[02-21 08:47:37.113] app.py (201) - [INFO] : 执行热重载 scope=provider

复现步骤

在llm-models.json中增加一个叫deepseek-r1-32b的模型,但是每次重载LLM之后就直接被删了。

启用的插件

未启动任何插件

@wang149876 wang149876 added the bug? Bug或Bug修复相关 label Feb 21, 2025
@RockChinQ
Copy link
Owner

贴一下你的llm-models.json内容?

@wang149876
Copy link
Author

{
"list": [
{
"name": "default",
"requester": "openai-chat-completions",
"token_mgr": "openai",
"tool_call_supported": false,
"vision_supported": false
},
{
"name": "gpt-4o",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-2024-11-20",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-2024-08-06",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-2024-05-13",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "chatgpt-4o-latest",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-mini",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "o1-preview",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "o1-mini",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4-turbo",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-3.5-turbo",
"tool_call_supported": true,
"vision_supported": false
},
{
"model_name": "SparkDesk",
"name": "OneAPI/SparkDesk"
},
{
"model_name": "gemini-pro",
"name": "OneAPI/gemini-pro"
},
{
"name": "claude-3-opus-latest",
"requester": "anthropic-messages",
"token_mgr": "anthropic",
"vision_supported": true
},
{
"name": "claude-3-5-sonnet-latest",
"requester": "anthropic-messages",
"token_mgr": "anthropic",
"vision_supported": true
},
{
"name": "claude-3-5-haiku-latest",
"requester": "anthropic-messages",
"token_mgr": "anthropic",
"vision_supported": true
},
{
"name": "moonshot-v1-8k",
"requester": "moonshot-chat-completions",
"token_mgr": "moonshot",
"tool_call_supported": true
},
{
"name": "moonshot-v1-32k",
"requester": "moonshot-chat-completions",
"token_mgr": "moonshot",
"tool_call_supported": true
},
{
"name": "moonshot-v1-128k",
"requester": "moonshot-chat-completions",
"token_mgr": "moonshot",
"tool_call_supported": true
},
{
"name": "deepseek-chat",
"requester": "deepseek-chat-completions",
"token_mgr": "deepseek",
"tool_call_supported": true
},
{
"name": "deepseek-coder",
"requester": "deepseek-chat-completions",
"token_mgr": "deepseek"
},
{
"name": "deepseek-reasoner",
"requester": "deepseek-chat-completions",
"token_mgr": "deepseek"
},
{
"name": "grok-2-latest",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "grok-2",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "grok-2-vision-1212",
"requester": "xai-chat-completions",
"token_mgr": "xai",
"vision_supported": true
},
{
"name": "grok-2-1212",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "grok-vision-beta",
"requester": "xai-chat-completions",
"token_mgr": "xai",
"vision_supported": true
},
{
"name": "grok-beta",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "glm-4-plus",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-0520",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-air",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-airx",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-long",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-flashx",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-flash",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4v-plus",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "glm-4v",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "glm-4v-flash",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "glm-zero-preview",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
}
]
}

上面是默认的
{
"list": [
{
"name": "default",
"requester": "openai-chat-completions",
"token_mgr": "openai",
"tool_call_supported": false,
"vision_supported": false
},
{
"name": "gpt-4o",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-2024-11-20",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-2024-08-06",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-2024-05-13",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "chatgpt-4o-latest",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4o-mini",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "o1-preview",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "o1-mini",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4-turbo",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-4",
"tool_call_supported": true,
"vision_supported": true
},
{
"name": "gpt-3.5-turbo",
"tool_call_supported": true,
"vision_supported": false
},
{
"model_name": "SparkDesk",
"name": "OneAPI/SparkDesk"
},
{
"model_name": "gemini-pro",
"name": "OneAPI/gemini-pro"
},
{
"name": "claude-3-opus-latest",
"requester": "anthropic-messages",
"token_mgr": "anthropic",
"vision_supported": true
},
{
"name": "claude-3-5-sonnet-latest",
"requester": "anthropic-messages",
"token_mgr": "anthropic",
"vision_supported": true
},
{
"name": "claude-3-5-haiku-latest",
"requester": "anthropic-messages",
"token_mgr": "anthropic",
"vision_supported": true
},
{
"name": "moonshot-v1-8k",
"requester": "moonshot-chat-completions",
"token_mgr": "moonshot",
"tool_call_supported": true
},
{
"name": "moonshot-v1-32k",
"requester": "moonshot-chat-completions",
"token_mgr": "moonshot",
"tool_call_supported": true
},
{
"name": "moonshot-v1-128k",
"requester": "moonshot-chat-completions",
"token_mgr": "moonshot",
"tool_call_supported": true
},
{
"name": "deepseek-chat",
"requester": "deepseek-chat-completions",
"token_mgr": "deepseek",
"tool_call_supported": true
},
{
"name": "deepseek-coder",
"requester": "deepseek-chat-completions",
"token_mgr": "deepseek"
},
{
"name": "deepseek-reasoner",
"requester": "deepseek-chat-completions",
"token_mgr": "deepseek"
},
{
"name": "grok-2-latest",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "grok-2",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "grok-2-vision-1212",
"requester": "xai-chat-completions",
"token_mgr": "xai",
"vision_supported": true
},
{
"name": "grok-2-1212",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "grok-vision-beta",
"requester": "xai-chat-completions",
"token_mgr": "xai",
"vision_supported": true
},
{
"name": "grok-beta",
"requester": "xai-chat-completions",
"token_mgr": "xai"
},
{
"name": "glm-4-plus",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-0520",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-air",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-airx",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-long",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-flashx",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4-flash",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai"
},
{
"name": "glm-4v-plus",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "glm-4v",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "glm-4v-flash",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "glm-zero-preview",
"requester": "zhipuai-chat-completions",
"token_mgr": "zhipuai",
"vision_supported": true
},
{
"name": "deepseek-r1-32b",
"model_name": "deepseek-ai/DeepSeek-R1-Distill-Qwen-32B",
"requester": "siliconflow-chat-completions",
"token_mgr": "siliconflow",
"vision_supported": false
}
]
}
下面是我改过的,就加了一个deepseek-r1-32b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug? Bug或Bug修复相关
Projects
None yet
Development

No branches or pull requests

2 participants