Structured Streaming tips

December 22, 2019

How to create a schema for Apache Kafka source in Structured Streaming?

Usually you can define a schema on your input data from .schema(...) function of Apache Spark SQL: val ordersFromJson = testedSparkSession.read.schema(orderSchema) .json(ordersToAddFile) Ho...

Continue Reading →