data locality articles

on waitingforcode.com
Articles tagged with data locality. There are 2 article(s) corresponding to the tag data locality. If you don't find what you're looking for, please check related tags: Apache Spark 2.4.0 features, Apache Spark data sources, AWS EC2, Big Data patterns implemented, Cerberus + PySpark, Change Data Capture, completable future, custom state store, data patterns, errors in Scala.

Check out my new course on Data Engineering!

Are you a data scientist who wants to extend his data engineering skills? Or a software engineer who wants to work with Big Data? If not, maybe a BI developer who wants to evolve to engineering position? My course will help you to achieve your goal! Join the class →

Spark data locality

If you've ever analyzed Spark UI, you've certainly seen the part of Locality level in the table with tasks. Even if this concept is less exposed than the topics as shuffle, it remains quite important in efficient data processing. Continue Reading →