Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting started guide client samples broken ? #3348

Open
nikste opened this issue Oct 15, 2024 · 1 comment
Open

Getting started guide client samples broken ? #3348

nikste opened this issue Oct 15, 2024 · 1 comment

Comments

@nikste
Copy link

nikste commented Oct 15, 2024

🐛 Describe the bug

following the getting started guide:

https://github.com/pytorch/serve/blob/master/docs/getting_started.md

i get following error messages when trying to run the client examples.
Am I doing something wrong?

Error logs

serve$ python -m grpc_tools.protoc --proto_path=frontend/server/src/main/resources/proto/ --python_out=ts_scripts --grpc_python_out=ts_scripts frontend/server/src/main/resources/proto/inference.proto frontend/server/src/main/resources/proto/management.proto
google/rpc/status.proto: File not found.
inference.proto:6:1: Import "google/rpc/status.proto" was not found or had errors.
inference.proto:32:14: "google.rpc.Status" is not defined.

and

serve$ python ts_scripts/torchserve_grpc_client.py infer densenet161 examples/image_classifier/kitten.jpg
Traceback (most recent call last):
  File "[..]serve/ts_scripts/torchserve_grpc_client.py", line 7, in <module>
    import inference_pb2
ModuleNotFoundError: No module named 'inference_pb2'

Installation instructions

followed the getting started guide:
https://github.com/pytorch/serve/blob/master/docs/getting_started.md

Model Packaging

from getting started guide

config.properties

from getting started guide

Versions


Environment headers

Torchserve branch:

torchserve==0.12.0
torch-model-archiver==0.12.0

Python version: 3.10 (64-bit runtime)
Python executable: /home/nikste/workspace-abnoba/serving_test/venv/bin/python

Versions of relevant python libraries:
captum==0.6.0
numpy==1.24.3
nvgpu==0.10.0
pillow==10.3.0
psutil==5.9.8
requests==2.32.0
torch==2.4.0+cu121
torch-model-archiver==0.12.0
torch-workflow-archiver==0.2.15
torchaudio==2.4.0+cu121
torchserve==0.12.0
torchvision==0.19.0+cu121
wheel==0.42.0
torch==2.4.0+cu121
**Warning: torchtext not present ..
torchvision==0.19.0+cu121
torchaudio==2.4.0+cu121

Java Version:

OS: Ubuntu 22.04.5 LTS
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: 14.0.0-1ubuntu1.1
CMake version: version 3.30.3

Environment:
library_path (LD_/DYLD_): /usr/local/cuda-11.8/lib64:

Repro instructions

getting started guide

Possible Solution

missing packages in the requirements?

@CongSuxu
Copy link

https://github.com/googleapis/googleapis/tree/master download this and move the "google" folder to serve\frontend\server\src\main\resources\proto.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants