MLflow runtime for MLServer¶
This package provides a MLServer runtime compatible with MLflow models.
You can install the runtime, alongside
pip install mlserver mlserver-mlflow
The MLflow inference runtime introduces a new
dict content type, which
decodes an incoming V2 request as a dictionary of
This is useful for certain MLflow-serialised models, which will expect that the
model inputs are serialised in this format.
dict content type can be stacked with other content types, like
This allows the user to use a different set of content types to decode each of
the dict entries.