The only way you can build fault-resilient systems is to frequently test fault injection scenarios.  Netflix is pretty mature in this regard, perhaps Github can learn from their example.<p>That said, it&#x27;s possible that github may have considered that this particular style of outage is rare enough that they don&#x27;t want to make their design tolerate it.  Though if that were the case, I&#x27;d wager they&#x27;d re-evaluate the cost&#x2F;benefit right around now.  :)