Building and operating a pretty big storage system called S3

In this post, I want to cover a few of the interesting nuances of building something like S3, and the lessons learned and sometimes surprising observations...