New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

本项目如何使用自定义模型？ #7

Open

ZMXJJ opened this issue Dec 7, 2024 · 1 comment

ZMXJJ commented Dec 7, 2024

作者您好，我想使用该库调用自己部署的模型，请问该如何设置相关变量？

Owner

arcstep commented Dec 7, 2024

建议你直接将其部署为兼容 OpenAI 接口的 API服务，然后配置 BaseURL 和 API_KEY 就可以了。

否则就需要自定义ChatAgent子类，可以参考OpenAI的实现方式：
https://github.com/arcstep/illufly/blob/main/illufly/community/openai/chat.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment