Skip to content
Back to pull request #360

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B #282

Sign in to view logs

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B #282

Run time

Learn about OS pricing on GitHub Actions
Job Run time
kubeai
22s
22s