The process of integrating a machine learning model into a production environment, making it accessible for end-users or other systems to generate predictions or insights

Model Deployment Modes

<aside> 💡

Comparing methods

</aside>

image.png

Why is Spark Slow in Online Scoring?

<aside> 💡

Spark is primarily designed for batch and streaming deployments

</aside>

image.png

Deploying a Single-Node model on a Spark DataFrame

image.png

Deploying a Spark ML Model on a Spark DataFrame

image.png

Code Example

image.png

Conclusions:

Inference with Spark

Approaches to Model Inferencing with Spark

<aside> 💡

Methods for Deploying and Running Inference

</aside>