Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Whisper pipeline: use Sampler #1615

Draft
wants to merge 26 commits into
base: master
Choose a base branch
from
Draft

Whisper pipeline: use Sampler #1615

wants to merge 26 commits into from
+650 −299

Conversation

as-suvorov
Copy link
Contributor

No description provided.

@as-suvorov
use decoder interface
68d3e48
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
ade7313
@as-suvorov
remove reshape
b2df4a6
@as-suvorov
use stateful seq2seq barnch
17e3ea7
@as-suvorov
Address review comments
806b01a
@as-suvorov
Rename
e041a33
@as-suvorov
Use commit
9502d9b
@as-suvorov
Set tests reqs
6c30fa4
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
7600072
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
f870a4c
@as-suvorov
Add with_past model tests
e38cf5c
@as-suvorov
remove comment
acc656f
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/statefull_whisper
aa0f742
@as-suvorov
bump tokenizers
3728884
@as-suvorov
Fix typo
445ce5a
@as-suvorov
Add deprecation message
5bdd695
@as-suvorov
Use sampler for whisper pipeline
7f2a153
@as-suvorov
Add with past decoder
c368401
@as-suvorov
Refactor with past decoder
2e061aa
@as-suvorov
Do not copy encoder_hidden_states if not needed
4eaa9a7
@as-suvorov
Merge remote-tracking branch 'upstream/master' into as/sampler_for_wh…
3139a43 
…isper
@as-suvorov
Add stubs
50fb829
@as-suvorov
Remove comment
5021742
@as-suvorov as-suvorov added this to the 2025.1 milestone Jan 22, 2025
@github-actions github-actions bot added category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: whisper Whisper pipeline category: sampling Sampling / Decoding algorithms labels Jan 22, 2025
@github-actions github-actions bot added category: Python API Python API for GenAI category: GenAI C++ API Changes in GenAI C++ public headers no-match-files labels Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilya-lavrenov ilya-lavrenov ilya-lavrenov left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: whisper Whisper pipeline do_not_merge do_not_review no-match-files
Projects
None yet
Milestone
2025.1
Development

Successfully merging this pull request may close these issues.
2 participants
@as-suvorov @ilya-lavrenov