When partitioning data across a set of cluster nodes we need a uniform distribution and to be able add and remove nodes to the cluster without causing a lot of data to be moved around. Unmesh Joshi explains how to do this by allocating data to a large number of virtual fixed partitions which are then allocated to the nodes.
https://martinfowler.com/articles/patterns-of-distributed-systems/fixed-partitions.html
Connectez-vous pour ajouter un commentaire
Autres messages de ce groupe
How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou
How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou
At Thoughtworks, we are strong practitioners of Test Driven Development (TDD). Naturally this leads to the question of how generative AI can