View profile

Systems Papers - Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications

Micah Lerner
Micah Lerner
Hello! I’m trying out a new way of sending out my newsletter - if you notice any problems feel free to reach out on Twitter or by responding to this email!

Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications
Hello new and old subscribers!
This week’s paper, Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications, describes a system for running sharded applications at scale within Facebook - link to the paper review here.
Application sharding assigns subsets of requests to instances of an application, allowing tasks to specialize - a group of tasks specialized for a subset of requests is called a shard.
This approach is particularly useful when tasks fetch state or other metadata. As an example, a speech recognition application may load machine learning models to process languages. Assigning requests for different languages to different shards means that an application’s tasks don’t need to download every model (which would be time and bandwidth-intensive).
As always, feel free to reach out with comments or suggestions by responding to this email.
Until next time!
Micah
Did you enjoy this issue? Yes No
Micah Lerner
Micah Lerner @micahlerner

I write about papers from the worlds of distributed systems, operating systems, and computer security (among other technical topics!)

Previous issues available on www.micahlerner.com

In order to unsubscribe, click here.
If you were forwarded this newsletter and you like it, you can subscribe here.
Created with Revue by Twitter.