http://www.pagerduty.com/blog/the-discovery-of-apache-zookeepers-poison-packet/
Yeah, this was a great read. Detailed post-mortem’s like this can be fascinating.