This is a toy project illustrating how to process a mock stream of sensor data via Spark structured streaming and the (older) dstreams API. A discussion of this code is available in this blog post: http://datalackey.com/2019/07/01/sliding-window-processing-spark-structured-streaming-vs-dstreams/
-
Notifications
You must be signed in to change notification settings - Fork 0
datalackey/spark-structured-streaming-vs-dstreams
About
toy project illustrating how to process a mock stream of sensor data via Spark structured streaming and the (older) dstreams API