Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add max input/output tokens for providers on models #12

Open
richmailYT opened this issue Jan 2, 2025 · 0 comments
Open

Add max input/output tokens for providers on models #12

richmailYT opened this issue Jan 2, 2025 · 0 comments

Comments

@richmailYT
Copy link
Contributor

Although the models themselves may be advertised as supporting 128k input/output tokens, the providers themselves may not support it.

I propose that those metrics be added to give users more information on the trade offs between using the model from one provider compared to another besides just price and throughput.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant