horizontal scalability articles

on waitingforcode.com
Articles tagged with horizontal scalability. There are 1 article(s) corresponding to the tag horizontal scalability. If you don't find what you're looking for, please check related tags: AWS EC2, Big Data patterns implemented, Cerberus + PySpark, Change Data Capture, custom state store, custom state store, hybrid orchestration and coordination, idempotent consumer, Kubernetes, random algorithms.

Check out my new course on Data Engineering!

Are you a data scientist who wants to extend his data engineering skills? Or a software engineer who wants to work with Big Data? If not, maybe a BI developer who wants to evolve to engineering position? My course will help you to achieve your goal! Join the class →

Introduction to horizontal scalability

Two great features whose I experienced when I have been working with Dataflow were the serverless character and the auto-scalability. That's why when I first saw the Apache Spark on Kubernetes initiative, I was more than happy to write one day the pipelines automatically adapting to the workload. That also encouraged me to discover the horizontal scalability and this post is the first result of my recent research on that topic. Continue Reading →