We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
比如连续对话中,有些对话其实没必要添加到上下文里。
可以默认设置为都是添加到上下文,但可以在那一轮对话上取消标记,之后问答时,取消标记的对话就不添加到上下文了。
这样可以把对话历史和上下文分开,减少显卡的压力,应该能实现更多轮次的对话
The text was updated successfully, but these errors were encountered:
可以暂时先用读取对话的功能。具体方法是对话完成后保存成json,vscode打开,手动删掉不需要的部分(也可以修改内容),保存,最后在WebUI中读取。
Sorry, something went wrong.
No branches or pull requests
比如连续对话中,有些对话其实没必要添加到上下文里。
可以默认设置为都是添加到上下文,但可以在那一轮对话上取消标记,之后问答时,取消标记的对话就不添加到上下文了。
这样可以把对话历史和上下文分开,减少显卡的压力,应该能实现更多轮次的对话
The text was updated successfully, but these errors were encountered: