Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Respond only with text and without audio ,when the conversation.item.create event sends assistant text messages to populate the conversation history. #72

Open
hsycc opened this issue Nov 18, 2024 · 2 comments

Comments

@hsycc
Copy link

hsycc commented Nov 18, 2024

like this

{
    "event_id": "event_345",
    "type": "conversation.item.create",
    "previous_item_id": null,
    "item": {
        "id": "msg_001",
        "type": "message",
        "role": "assistant",
        "content": [
            {
                "type": "text",
                "text": "Hello"
            }
        ]
    }
}
image
@hsycc hsycc changed the title Only respond with text when the conversation.item.create event sends assistant text messages to populate the conversation history. Respond only with text when the conversation.item.create event sends assistant text messages to populate the conversation history. Nov 18, 2024
@hsycc
Copy link
Author

hsycc commented Nov 18, 2024

Pasted Graphic see the document, has the current limitation that it cannot populate assistant audio messages.

Is the lack of audio response at present a bug?

@hsycc hsycc changed the title Respond only with text when the conversation.item.create event sends assistant text messages to populate the conversation history. Respond only with text and without audio ,when the conversation.item.create event sends assistant text messages to populate the conversation history. Nov 18, 2024
@LaKing
Copy link

LaKing commented Jan 3, 2025

I would assume that modalities: ["audio", "text"] for the client session would adjust session-wide, but it seems not to, in fact removing audio makes the api or the model just hang.

It would be nice to find a way to set if we need audio responses or not. ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants