Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Android Llama-3.2-3B-Instruct-q4f16_0-MLC init failed #3048

Open
tdd102 opened this issue Nov 26, 2024 · 1 comment
Open

[Bug] Android Llama-3.2-3B-Instruct-q4f16_0-MLC init failed #3048

tdd102 opened this issue Nov 26, 2024 · 1 comment
Labels
bug Confirmed bugs

Comments

@tdd102
Copy link

tdd102 commented Nov 26, 2024

🐛 Bug

/Users/tiandongdong/Downloads/mlc-llm-test/android/mlc-llm/android/mlc4j/../../3rdparty/tvm/src/runtime/relax_vm/ndarray_cache_support.cc:193: Check failed: this->nbytes == raw_data_buffer->length() (31463424 vs. 30307685) : ValueError: Encountered an corrupted parameter shard. It means it is not downloaded completely or downloading is interrupted. Please try to download again.
2024-11-26 13:43:41.011 8735-11657 TVM_RUNTIME ai.mlc.mlcchat A /Users/tiandongdong/Downloads/mlc-llm-test/android/mlc-llm/android/mlc4j/../../3rdparty/tvm/src/runtime/relax_vm/ndarray_cache_support.cc:255: ValueError: Error when loading parameters from params_shard_30.bin: [13:43:41] /Users/tiandongdong/Downloads/mlc-llm-test/android/mlc-llm/android/mlc4j/../../3rdparty/tvm/src/runtime/relax_vm/ndarray_cache_support.cc:193: Check failed: this->nbytes == raw_data_buffer->length() (31463424 vs. 30307685) : ValueError: Encountered an corrupted parameter shard. It means it is not downloaded completely or downloading is interrupted. Please try to download again.
Stack trace not available when DMLC_LOG_STACK_TRACE is disabled at compile time.
2024-11-26 13:43:41.034 8735-11657 AndroidRuntime ai.mlc.mlcchat E FATAL EXCEPTION: Thread-5
Process: ai.mlc.mlcchat, PID: 8735
org.apache.tvm.Base$TVMError: ValueError: Error when loading parameters from params_shard_30.bin: [13:43:41] /Users/tiandongdong/Downloads/mlc-llm-test/android/mlc-llm/android/mlc4j/../../3rdparty/tvm/src/runtime/relax_vm/ndarray_cache_support.cc:193: Check failed: this->nbytes == raw_data_buffer->length() (31463424 vs. 30307685) : ValueError: Encountered an corrupted parameter shard. It means it is not downloaded completely or downloading is interrupted. Please try to download again.
Stack trace:
File "/Users/tiandongdong/Downloads/mlc-llm-test/android/mlc-llm/android/mlc4j/../../3rdparty/tvm/src/runtime/relax_vm/ndarray_cache_support.cc", line 255

                                                                                                	at org.apache.tvm.Base.checkCall(Base.java:173)
                                                                                                	at org.apache.tvm.Function.invoke(Function.java:130)
                                                                                                	at ai.mlc.mlcllm.JSONFFIEngine.runBackgroundLoop(JSONFFIEngine.java:64)
                                                                                                	at ai.mlc.mlcllm.MLCEngine$backgroundWorker$1.invoke(MLCEngine.kt:42)
                                                                                                	at ai.mlc.mlcllm.MLCEngine$backgroundWorker$1.invoke(MLCEngine.kt:40)
                                                                                                	at ai.mlc.mlcllm.BackgroundWorker$start$1.invoke(MLCEngine.kt:19)
                                                                                                	at ai.mlc.mlcllm.BackgroundWorker$start$1.invoke(MLCEngine.kt:18)
                                                                                                	at kotlin.concurrent.ThreadsKt$thread$thread$1.run(Thread.kt:30)
@tdd102 tdd102 added the bug Confirmed bugs label Nov 26, 2024
@Hzfengsy
Copy link
Member

Encountered an corrupted parameter shard. It means it is not downloaded completely or downloading is interrupted. Please try to download again.

Please try to delete local cache and download again :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Confirmed bugs
Projects
None yet
Development

No branches or pull requests

2 participants