Introduction

• Introduction to Distributed System Design - Google Code University

Communication

• Andrew D. Birrell and Bruce Jay Nelson Implementing Remote Procedure Calls. ACM Trans. Comput. Syst., 2(1):39-59, 1984.
• Optional:
  • Anuj Kalia, Michael Kaminsky, and David Andersen. Datacenter RPCs can be General and Fast. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19), pp. 1-16, 2019.

Ordering

• L. Lamport. Time, Clocks, and the Ordering of Events in a Distributed System. Communications of the ACM, July 1978, pages 558-564.
• M. Chandy and L. Lamport. Distributed Snapshots: Determining Global States of Distributed Systems. ACM Trans. Comput. Syst., 3(1):63-75, 1985.
• Optional:
  • Friedemann Mattern. Virtual Time and Global States of Distributed Systems. 1988.

Failures

• Jim Gray. Why do computers stop and what can be done about it?. Symposium on reliability in distributed software and database systems. 1986.
• Bianca Schroeder and Garth A. Gibson. Disk failures in the real world: What does an MTTF of 1, 000, 000 hours mean to you?.. FAST. Vol. 7. No. 1. 2007.
• Optional:
  • David Oppenheimer, Archana Ganapathi, and David A. Patterson. Why do Internet services fail, and what can be done about it?. 4th Usenix Symposium on Internet Technologies and Systems (USITS 03), 2003.
  • Peng Huang, Chuanxiong Guo, Lidong Zhou, Jacob Rubin Lorch, Yingnong Dang, Murali Chintalapati, and Randolph Yao. Gray Failure: The Achilles' Heel of Cloud-Scale Systems. Proceedings of the 16th Workshop on Hot Topics in Operating Systems (HotOS), 2017.

Failure Detection

• Joshua Leners, Hao Wu, Wei-Lun Hung, Marcos K. Aguilera, and Michael Walfish. Detecting failures in distributed systems with the FALCON spy network. ACM Symposium on Operating Systems Principles (SOSP 11), October 2011.
• Optional:
  • Peng Huang, Chuanxiong Guo, Jacob R. Lorch, Lidong Zhou, and Yingnong Dang. Capturing and Enhancing In Situ System Observability for Failure Detection. 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18), 2018.

Fault-Tolerance

Replication

• Robbert van Renesse and Fred B. Schneider. Chain Replication for Supporting High Throughput and Availability. OSDI 2004.
• Daniel J. Scales, Mike Nelson, and Ganesh Venkitachalam The Design of aPractical System for Fault-Tolerant Virtual Machines. OSR 2010.
• Optional:
  • Navin Budhiraja, Keith Marzullo, Fred B. Schneider, and Sam Toueg. Optimal Primary-Backup Protocols. International Workshop on Distributed Algorithms. Springer, Berlin, Heidelberg, 1992.
  • Fred B. Schneider. Implementing fault-tolerant services using the state machine approach: A tutorial. ACM Computing Surveys (CSUR) 22.4 (1990): 299-319.
  • Brendan Cully, Geoffrey Lefebvre, Dutch Meyer, Mike Feeley, Norm Hutchinson, and Andrew Warfield. Remus: High availability via asynchronous virtual machine replication. In Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation (NSDI), pp. 161-174. 2008.

Consensus

• Leslie Lamport. Paxos Made Simple. ACM SIGACT News, 2001.
• Diego Ongaro and John Ousterhout. In Search of an Understandable Consensus Algorithm (Extended Version). In 2014 USENIX Annual Technical Conference (ATC 14), 2014.
• Dan RK Ports, Jialin Li, Vincent Liu, Naveen Kr Sharma, and Arvind Krishnamurthy. Designing distributed systems using approximate synchrony in data center networks. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). 2015.
• Iulian Moraru, David G. Andersen, and Michael Kaminsky. There is more consensus in egalitarian parliaments. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles (SOSP), 2013.
• Mike Burrows. The Chubby Lock Service for Loosely-Coupled Distributed Systems. OSDI 2006.
• Optional:
  • Barbara Liskov and James Cowling. Viewstamped replication revisited. 2012.
  • Patrick Hunt, Mahadev Konar, Flavio Paiva Junqueira, and Benjamin Reed. ZooKeeper: Wait-free Coordination for Internet-scale Systems. In USENIX annual technical conference (ATC), 2010.

Byzantine

• Miguel Castro and Barbara Liskov. Practical Byzantine Fault Tolerance. OSDI, 1999.
• Optional:
  • L. Lamport, R. Shostak, and M. Pease. The Byzantine Generals Problem. ACM Transactions on Programming Languages and Systems, July 1982, pages 382-401.
  • Ramakrishna Kotla, Lorenzo Alvisi, Mike Dahlin, Allen Clement, and Edmund Wong. Zyzzyva: Speculative Byzantine Fault Tolerance. SOSP 2007.

Distributed transactions

• Butler Lampson, and David B. Lomet. A new presumed commit optimization for two phase commit. VLDB. Vol. 93. 1993.
• Corbett et al. Spanner: Google’s Globally-Distributed Database. OSDI 2012.
• Optional:
  • Irene Zhang, Naveen Kr. Sharma, Adriana Szekeres, Arvind Krishnamurthy, and Dan R. K. Ports. Building Consistent Transactions with Inconsistent Replication. SOSP 2015.

Consistency and availability

• David K. Gifford. Weighted voting for replicated data. Proceedings of the seventh ACM symposium on Operating systems principles (SOSP), 1979.
• Eric Brewer. CAP Theorem. PODC Keynote, 2000.
• Collin Lee, Seo Jin Park, Ankita Kejriwal, Satoshi Matsushita, and John Ousterhout. Implementing Linearizability at Large Scale and Low Latency. In Proceedings of the 25th Symposium on Operating Systems Principles (SOSP), 2015.
• Syed Akbar Mehdi, Cody Littley, Natacha Crooks, Lorenzo Alvisi, Nathan Bronson, and Wyatt Lloyd. I can’t believe it’s not causal! scalable causal consistency with no slowdown cascades. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), 2017.
• Terry et al. Managing update conflicts in Bayou, a weakly connected replicated storage system. SOSP, 1995.
• Douglas Terry. Replicated data consistency explained through baseball. Communications of the ACM, Dec 2013.
• Optional:
  • Wyatt Lloyd, Michael J. Freedman, Michael Kaminsky, and David G. Andersen. Don't settle for eventual: scalable causal consistency for wide-area storage with COPS. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles (SOSP), 2011.
  • Lu et al. Existential consistency: measuring and understanding consistency at Facebook. In Proceedings of the 25th Symposium on Operating Systems Principles (SOSP), 2015.

Distributed storage

• R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, and B. Lyon. Design and implementation of the sun network filesystem. In Proceedings of USENIX Summer Techincal Conference, 1985.
• J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Trans. Comput. Syst., 6(1):51-81, 1988.
• S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. SIGOPS Oper. Syst. Rev., 37(5):29-43, 2003.
• Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber. Bigtable: A Distributed Storage System for Structured Data. In Seventh Symposium on Operating System Design and Implementation (OSDI), Seattle, WA, November, 2006.
• Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swami Sivasubramanian, Peter Vosshall and Werner Vogels. Dynamo: Amazon's Highly Available Key-Value Store. Proceedings of the 21st ACM Symposium on Operating Systems Principles, Stevenson, WA, October 2007
• Diego Ongaro, Stephen M. Rumble, Ryan Stutsman, John Ousterhout, and Mendel Rosenblum. Fast Crash Recovery in RAMCloud. SOSP 2011.
• Optional:
  • Edmund Nightingale, Peter M. Chen, and Jason Flinn. Speculative execution in a distributed file system. In SOSP 2005.

Data analytics and ML

• Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. OSDI'04.
• Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker, Ion Stoica. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. NSDI 2012. April 2012.
• Martín Abadi et al. Tensorflow: A system for large-scale machine learning.. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), 2016.
• Mu Li, David G. Andersen, Jun Woo Park, Alexander J. Smola, Amr Ahmed, Vanja Josifovski, James Long, Eugene J. Shekita, and Bor-Yiing Su. Scaling distributed machine learning with the parameter server.. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14), 2014.
• Optional:
  • Daniel Crankshaw, Xin Wang, Guilio Zhou, Michael J. Franklin, Joseph E. Gonzalez, and Ion Stoica. Clipper: A low-latency online prediction serving system. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), 2017.
  • Jack Kosaian, K. V. Rashmi, and Shivaram Venkataraman. Parity models: erasure-coded resilience for prediction serving systems. In Proceedings of the 27th ACM Symposium on Operating Systems Principles(SOSP), 2019.

Distributed ledgers

• Satoshi Nakamoto. Bitcoin: A Peer-to-Peer Electronic Cash System.