Big Data patterns implemented articles

Articles tagged with Big Data patterns implemented. There are 3 article(s) corresponding to the tag Big Data patterns implemented. If you don't find what you're looking for, please check related tags: Change Data Capture, hybrid orchestration and coordination, idempotent consumer, random algorithms, Spark SQL and Avro, Structured Streaming Kafka integration.

Big Data patterns implemented - automated processing metadata insertion

Sometimes metadata is disregarded but very often it helps to retrieve the information easier and faster. One of such use cases are the headers of Apache Parquet where the stats about the column's content are stored. The reader can, without parsing all the lines, know whether what is he looking for is in the file or not. The metadata is also a part of one of Big Data patterns called automated processing metadata insertion. Continue Reading →