Browse Teach Curate

A Partition Is the Unit of Both Ordering and Parallelism

This is the hinge node of the whole transport sub-domain and one of the two or three most load-bearing nodes in the curation. The outcome names 'which key their data is partitioned by' explicitly, and every scaling move the learner will make — adding consumers, adding capacity, diagnosing a slow consumer — is expressed in partitions. Offsets, consumer groups, capacity ceilings and fan-out all become unstateable without it.

jeremy Video

Topic Partitioning in Apache Kafka

Topic partitioning in a distributed log-based messaging system is the mechanism of splitting a single topic's log into multiple independent logs (partitions), each hosted on a separate node, so that …