Tracking Total Usage Cost of a Session with Claude Model.

[naphatkps]

Hi everyone,

I'm developing a chatbot application with a multi-agent architecture that communicates using WebSocket. The chatbot uses the claude-3-5-sonnet-20240620 model. To start a session, I use the a_initiate_chat function, which returns a ChatResult object. However, I’ve noticed that the cost property of the ChatResult object is always None.

Since I need to track the total usage cost of each session accurately, this has become a roadblock. Does anyone know why the cost property might not be populated or how to properly retrieve and calculate the cost for each session?

Any guidance or examples would be greatly appreciated!

Thanks in advance!

[ekzhu]

Dollar cost tracking is not available for this model because we don't have the info in the code.

As of now, I suggest performing dollar cost accounting as part of your app or use an external lib for this.