Bitzu

Machine Learning Associate ยท Deploying and serving models

Streaming inference with Delta Live Tables

Applying a model to a stream inside a Delta Live Tables pipeline, with managed autoscaling, versus Structured Streaming jobs.

Key points

  • Delta Live Tables (now branded Lakeflow Spark Declarative Pipelines): declare a streaming table over an incremental source and apply a model to its rows, e.g. via a Spark UDF from a registered model.
  • The pipeline manages orchestration, retries, optional compute autoscaling.
  • Each update processes only new data.
  • Hand-written Structured Streaming: same micro-batch engine, but you own cluster sizing, checkpoints, scheduling.

Source: https://docs.databricks.com/aws/en/dev-tools/cli/reference/pipelines-commands

Practice questions

Single choice

What does a Delta Live Tables pipeline do that a plain notebook with Structured Streaming does not do for you?

  1. It manages orchestration, retries and compute for the declared datasets
  2. It removes the need for a registered model
  3. It converts streams into synchronous REST calls
  4. It guarantees sub-10-millisecond latency
Show answer

Answer: A. It manages orchestration, retries and compute for the declared datasets

A pipeline is a managed, declarative runtime: you describe datasets and it handles orchestration, retries and compute management. It does not remove the need for a model or change what a stream is.

Select all that apply

Which statements describe streaming inference in a declarative pipeline correctly?

  1. Each update processes new data incrementally
  2. A model can be applied to rows of a streaming table
  3. Callers get a synchronous HTTP reply per record
  4. The pipeline retrains the model on every update
  5. Predictions can only be written to local files
Show answer

Answer: A. Each update processes new data incrementally, B. A model can be applied to rows of a streaming table

Pipelines process new data incrementally and the model is applied to rows of a streaming dataset. They are not request/response services and do not retrain the model automatically.

True or false

True or false: streaming inference means every single record is sent to a REST endpoint and the caller waits for the reply.

Show answer

Answer: False

False. That describes real-time serving. Streaming inference applies the model continuously to an incoming flow of records inside a pipeline, with no caller waiting.

Practice 8 questions on this topic in Bitzu

Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.

Download on the App StoreGet it on Google Play

More Machine Learning Associate topics in this module