Systems Papers - Ambry: LinkedIn’s Scalable Geo-Distributed Object Store
Hello new and old subscribers!
This is one of my first posts on Substack - if you have any feedback, I would love to hear it! Feel free to respond to this email with what is on your mind or if you have found any interesting papers recently.
This week’s paper is Ambry: LinkedIn’s Scalable Geo-Distributed Object Store.
Blob stores are used by companies across industry to store large objects, like photos and videos. This paper focuses on Ambry from LinkedIn which, unlike other implementations, is open source.
Ambry aims to provide low latency blob store operations, with high throughput, using globally distributed storage and compute resources. At the time of the paper’s publication in 2016, LinkedIn had hundreds of millions of users, and served more than 120 TB every day. To reach this scale, the team had to solve several challenges including wide variance in object sizes, rapid growth, and unpredictable read workloads.
The paper review is best enjoyed on my blog.
Until next time,
Micah