When partitioning data across a set of cluster nodes we need a uniform distribution and to be able add and remove nodes to the cluster without causing a lot of data to be moved around. Unmesh Joshi explains how to do this by allocating data to a large number of virtual fixed partitions which are then allocated to the nodes.
https://martinfowler.com/articles/patterns-of-distributed-systems/fixed-partitions.html
Login to add comment
Other posts in this group
How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou
How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou
Many s
At Thoughtworks, we are strong practitioners of Test Driven Development (TDD). Naturally this leads to the question of how generative AI can
