Channels ▼
RSS

Open Source

Rent A Chaos Monkey From Netflix


Video rental company Netflix has used its extensive consumption of the Amazon Web Services cloud to give something back to the open source community. The company's Chaos Monkey system was developed to ensure that its operations were capable of self-healing (or at least continuing to run) should instances in the AWS cloud fail. This month sees the firm open source its code.

The firm's Cory Bennett and Ariel Tseitlin have written on the Netflix techblog explaining that over the last year, "Chaos Monkey has terminated over 65,000 instances running in our production and testing environments. Most of the time nobody notices, but we continue to find surprises caused by Chaos Monkey, which allows us to isolate and resolve them so they don't happen again."

Chaos Monkey is perhaps not that "chaotic"; it is in fact completely configurable and is flexible enough to run on clouds other than AWS. "The software design is flexible enough to work with other cloud providers or instance groupings and can be enhanced to add that support," write the pair.

Justifying this open source release and clarifying that their company's technical prowess is fit for public consumption, Bennett and Tseitlin explain that because the cloud is all about redundancy and fault-tolerance — no single component can guarantee 100% uptime (and even the most expensive hardware eventually fails).

This means that Netflix had to design a cloud architecture where individual components can fail without affecting the availability of the entire system — and now the company has released this intelligence to the community contribution model of computing.

"In effect, we have to be stronger than our weakest link. We can use techniques like graceful degradation on dependency failures, as well as node-, rack-, datacenter/availability-zone, and even regionally-redundant deployments. But just designing a fault tolerant architecture is not enough. We have to constantly test our ability to actually survive these 'once in a blue moon' failures," write the pair.

Netflix says it has plans to open up more of its architecture and may move to release Janitor Monkey next, a cloud "clutter and waste" management tool. The firm also sports Latency Monkey, Conformity Monkey, Doctor Monkey, and Security Monkey among its "Simian Family" of technologies.


Related Reading


More Insights






Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
 

Video