Wei Wei, Developer Advocate at Google, shares several advanced TensorFlow Serving features (experimental). Learn how TF Serving can tend JAX models, serve non-TensorFlow models with new servables, and remotely predict RPC with distributed serving.
Resources:
TF Serving model server parameters →
Intro to JAX: Accelerating Machine Learning research →
Convert JAX models to SavedModel with jax2tf →
Convert JAX models to TFLite →
Creating a new kind of servable →
XGBoost Serving using TF Serving (community project) →
Hashmap servable reference on Github →
TensorFlow servable on Github →
Remote predict TensorFlow operator →
Deploying Production ML Models with TensorFlow Serving playlist →
Subscribe to TensorFlow →
#TensorFlow #MachineLearning #ML