You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Although the models themselves may be advertised as supporting 128k input/output tokens, the providers themselves may not support it.
I propose that those metrics be added to give users more information on the trade offs between using the model from one provider compared to another besides just price and throughput.
The text was updated successfully, but these errors were encountered:
Although the models themselves may be advertised as supporting 128k input/output tokens, the providers themselves may not support it.
I propose that those metrics be added to give users more information on the trade offs between using the model from one provider compared to another besides just price and throughput.
The text was updated successfully, but these errors were encountered: