Overall Observations and Assessment
- S3 reads (GET) are faster than S3 writes (PUT). There are three overall factors that may contribute to this difference:
- Cable Modem Download is over a magnitude faster than Upload.
- Most likely, a conservative write scheme is deployed by Amazon to ensure that the files being stored are backed up for high reliability.
- For S3 reads, potential in-memory file caching by S3 removes latency of reading from disks.
- Regardless of message size, the Amazon S3 Service reads (GET) are noticeably faster than SCP reads. The following factors may contribute to this difference:
- Most likely, Amazon deploys SSL concentrators or accelerators.
protocol has no such cryptographic acceleration.
- The SCP reads do not support caching whereas, most likely, S3 has sophisticated caching enables for reads.
- S3 Service writes (PUT) are somewhat slower than SCP writes. Most likely, S3 has a data mirroring schemes that requires multiple writes, where SCP directly writes to a single file system.
- S3 supports both MIME and DIME standards for SOAP with Attachments. For writes (PUT), there was little difference in performance between DIME and MIME for small files, with DIME performing slightly better. However, for large files DIME performed much better than MIME. For reads (GET), only DIME is returned and the user has no control over switching to MIME.
Amazon’s S3 Services provide a standards-based and high performance mechanism for managing content. S3’s performance characteristics make it ideal for end-user as well as enterprise applications where cost-effective data back up is desired. During our regression we never had a problem with reading or writing files. The S3 service had enterprise-class availability and reliability.
We anticipate that a number of both end-user application as well as complex enterprise-class applications will proliferate the market that are built on storage services such as S3. Such storage services and their derived applications will fulfill regulatory requirements for industries that have third party auditing and record keeping mandates. We also anticipate a number of privacy and integrity related services to be built on top of such storage services. The best part -- after a couple of weeks of testing with numerous uploads, downloads and large file storage, the Amazon S3 service cost us a mere 52 cents.