Skip to content

Commit

Permalink
Fix path to gguf_dump.py
Browse files Browse the repository at this point in the history
  • Loading branch information
countzero committed Jan 9, 2025
1 parent 1887a24 commit 1c07628
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion examples/server.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -179,7 +179,7 @@ try {
# We are trying to extract model details from the GGUF file.
# https://github.com/ggerganov/ggml/blob/master/docs/gguf.md#llm
# TODO: Find a robust way to resolve this values.
$modelData = Invoke-Expression "python ${llamaCppPath}\gguf-py\scripts\gguf_dump.py --no-tensors `"${model}`""
$modelData = Invoke-Expression "python ${llamaCppPath}\gguf-py\gguf\scripts\gguf_dump.py --no-tensors `"${model}`""
$modelContextLength = [Int]($modelData | Select-String -Pattern '\bcontext_length = (\d+)\b').Matches.Groups[1].Value
$modelHeadCount = [Int]($modelData | Select-String -Pattern '\bhead_count = (\d+)\b').Matches.Groups[1].Value
$modelBlockCount = [Int]($modelData | Select-String -Pattern '\bblock_count = (\d+)\b').Matches.Groups[1].Value
Expand Down
2 changes: 1 addition & 1 deletion vendor/llama.cpp
Submodule llama.cpp updated 652 files

0 comments on commit 1c07628

Please sign in to comment.