Skip to content
Llama Benchmarking 8B Tests

[shortfin][python] Skip tokenization in sd.server if request holds input_ids #1799

Sign in to view logs

[shortfin][python] Skip tokenization in sd.server if request holds input_ids

[shortfin][python] Skip tokenization in sd.server if request holds input_ids #1799

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Llama Benchmarking 8B Tests (3.11)
3m 5s
3m 5s