BentoML-0.8.2
What's New?
-
Support Debian-slim docker images for containerizing model server, #822 by @jackyzha0. User can choose to use :
@env( auto_pip_dependencies=True, docker_base_image="bentoml/model-server:0.8.2-slim-py37" )
-
New
bentoml retrieve
command for downloading saved bundle from remote YataiService model registry, #810 by @iancoffeybentoml retrieve ModelServe:20200610145522_D08399 --target_dir /tmp/modelserve
-
Added
--print-location
option tobentoml get
command to print the saved path, #825 by @jackyzha0$ bentoml get IrisClassifier:20200625114130_F3480B --print-location /Users/chaoyu/bentoml/repository/IrisClassifier/20200625114130_F3480B
-
Support Dataframe input JSON format orient parameter. DataframeInput now supports all pandas JSON orient options: records, columns, values split, index. #809 #815, by @bojiang
For example, with
orient="records"
:@api(input=DataframeInput(orient="records")) def predict(self, df): ...
The API endpoint will be expecting HTTP request with JSON payload in the following format:
[{"col 1":"a","col 2":"b"},{"col 1":"c","col 2":"d"}]
Or with
orient="index"
:'{"row 1":{"col 1":"a","col 2":"b"},"row 2":{"col 1":"c","col 2":"d"}}'
See pandas's documentation on the orient option of to_json/from_json function for more detail: https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_json.html
-
Support Azure Functions deployment (beta). A new fully automated cloud deployment option that BentoML provides in addition to AWS SageMaker and AWS Lambda. See usage documentation here: https://docs.bentoml.org/en/latest/deployment/azure_functions.html
-
ModelServer API Swagger schema improvements including the ability to specify example HTTP request, #807 by @Korusuke
-
Add prediction logging when deploying with AWS Lambda, #790 by @jackyzha0
-
Fixed micro batching parameter(max latency and max batch size) not applied, #818 by @bojiang
-
Fixed issue with handling CSV file input by following RFC4180. #814 by @bojiang
-
Fixed TfTensorOutput casts floats as ints #813, in #823 by @bojiang
Announcements:
- The BentoML team has created a new mailing list for future announcements, community-related discussions. Join now here!
- For those interested in contributing to BentoML, there is a new contributing docs now, be sure to check it out.
- We are starting a bi-weekly community meeting for community members to demo new features they are building, discuss the roadmap and gather feedback, etc. More details will be announced soon.