Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

希望添加手动标记对话是否添加到上下文的功能 #17

Open
ystyle opened this issue Mar 19, 2023 · 1 comment
Open

希望添加手动标记对话是否添加到上下文的功能 #17

ystyle opened this issue Mar 19, 2023 · 1 comment

Comments

@ystyle
Copy link

ystyle commented Mar 19, 2023

比如连续对话中,有些对话其实没必要添加到上下文里。

可以默认设置为都是添加到上下文,但可以在那一轮对话上取消标记,之后问答时,取消标记的对话就不添加到上下文了。

这样可以把对话历史和上下文分开,减少显卡的压力,应该能实现更多轮次的对话

@Kepler-16b
Copy link
Contributor

可以暂时先用读取对话的功能。具体方法是对话完成后保存成json,vscode打开,手动删掉不需要的部分(也可以修改内容),保存,最后在WebUI中读取。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants