Spark DataFrame

<aside> 💡

Use Spark DataFrames for scalable data manipulation

</aside>

Loading Data

<aside> 💡

Perform operations efficiently

</aside>

Reading Delta Tables with spark.read.table

Unity Catalog

Automated lineage for all workloads

Feature Engineering + Unity Catalog Feature Store

Overview of Spark ML

Machine Learning in Spark

ML Pipelines

<aside> 💡

spark.ml import Pipeline (refer to documentation)

</aside>