Channels ▼
RSS

Web Development

S3 Meets R3 (Reliability, Robustness, and Resilience)


Mamoon Yunus is CTO of Forum Systems and a pioneer of SOA Gateways & Firewalls. Prior to Forum, Mr. Yunus was at webMethods where he developed XML-based techology. Mamoon holds two Graduate Degrees in Engineering from MIT.

Rizwan Mallal is Technology Director at Crosscheck Networks and Chief Security Architect of Forum Systems. Previously, Rizwan held various positions at Sonicwall and Raptor (now Symantec). Rizwan holds a Masters in Computer Science from University of Vermont.


Amazon's entry into the online storage business has created a lot of buzz in the industry. The well-touted S3 (Simple Scalable Storage) web service holds the promise of providing reliable and robust virtual storage for users over the web. It’s provided as a storage service exposed via standard interfaces such as SOAP Web Services and REST that developers can leverage to build custom storage applications for end users.

The success of Amazon's S3 depends on two factors: first, consumers building successful business models from such services; and second, S3 providing a reliable and robust infrastructure to deliver such services. The robustness, reliability and resilience can create a positive user experience. Robustness and reliability in turn depend on the performance characteristics of this service, specifically the latency that determines the delay in storing or retrieving files.

To determine the latency that a user might experience with S3, we embarked on a project to measure typical file storage, file retrieval and other miscellaneous file operations. The latency of these file operations was based on the time it would take to store and retrieve files of multiple sizes ranging from a few kilobytes up to a few megabytes. Keeping in mind that performance is relative, we introduced a comparable latency metric by measuring how long it would take us to store/retrieve files of similar sizes to a remote server over the WAN (Wide Area Network) using Secure Copy (SCP) protocol. Granted, measuring the transfer time between the two different standards on different endpoints is not exactly an apples to apples comparison but it would still give us a fair estimation of where Amazon S3 service stands in comparison to a well-known industry standard such as SCP.

Based on our goals we decided to run multiple test results and produce metrics that would highlight the latency involved when accessing Amazon S3.


Related Reading


More Insights






Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
 
Dr. Dobb's TV