Spark SQL and Avro articles

on waitingforcode.com
Articles tagged with Spark SQL and Avro. There are 2 article(s) corresponding to the tag Spark SQL and Avro. If you don't find what you're looking for, please check related tags: AWS certification, bucketing in Spark SQL, Cerberus + PySpark, Cerberus + PySpark, certification journey, custom state store, custom state store, data security, Spark AI Summit Europe 2019 articles, Spark SQL aggregations.

Check out my new course on Data Engineering!

Are you a data scientist who wants to extend his data engineering skills? Or a software engineer who wants to work with Big Data? If not, maybe a BI developer who wants to evolve to engineering position? My course will help you to achieve your goal! Join the class →

Apache Spark 2.4.0 features - Avro data source

Apache Avro became one of the serialization standards, among others because of its use in Apache Kafka's schema registry. Previously to work with Avro files with Apache Spark we needed Databrick's external package. But it's no longer the case starting from 2.4.0 release where Avro became first-class citizen data source. Continue Reading →