When distributing data leads to lots of small messages around a cluster then network latency and the request processing time (including serialization, deserialization of the request on the server side) can add significant overhead. Unmesh Joshi shows how requests can be combined into a Request Batch to improve throughput.
https://martinfowler.com/articles/patterns-of-distributed-systems/request-batch.html
Login to add comment
Other posts in this group
How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou
How is code generation with GenAI different from more "traditional" code generators? The newest memo in Birgitta Böckeler's explorations of GenAI talks abou
Many s
At Thoughtworks, we are strong practitioners of Test Driven Development (TDD). Naturally this leads to the question of how generative AI can
