Spark and Hive articles

on waitingforcode.com
Articles tagged with Spark and Hive. There are 1 article(s) corresponding to the tag Spark and Hive. If you don't find what you're looking for, please check related tags: Apache Spark 2.4.0 features, Apache Spark data sources, AWS EC2, Big Data patterns implemented, completable future, data patterns, graph partitioning, horizontal scalability, idempotent consumer, Kubernetes.

Apache Spark SQL, Hive and insertInto command

Some time ago on my Github bithw1 pointed out an interesting behavior of Hive integration on Apache Spark SQL. To not delve too much into details now, I can tell that the behavior was about not respected DataFrame schema. Our quick exchange ended up with an explanation but it also encouraged me to go much more into details to understand the hows and whys. Continue Reading →