Elaborate on Amazon Storage Systems.

When we create an Amazon Machine Image(AMI) the storage allocated is temporal; it only exists for as long as instance is running.All of the data contained in that storage is lost when the instance is suspended or terminated,So, we need to have access to persistent storage. Amazon provide 3 type of storage

  • Amazon Simple Storage System (S3)
  • Amazon Elastic Block Store (EBS)
  • Amazon Elastic FileStore(EFS)
  • CloudFront
  • Glacier

Amazon Simple Storage System (S3)

  • Amazon S3’s cloud-based storage system allows you to store data objects ranging in size from 1 byte up to 5GB in a flat namespace.
  • In S3, storage containers are referred to as buckets, which serves the functions of a directory.
  • There is no object hierarchy to a bucket, and you save objects and not files to it.
  • It is important that you do not associate the concept of a filesystem with S3, because files are not supported; only objects are stored.
  • The S3 system allows you to assign a name to a bucket, but that name must be unique in the S3 namespace across all AWS customers.
  • Access to an S3 bucket is through the S3 Web API (either with SOAP or REST).
  • S3’s performance limits its use to non-operational functions such as data archiving and retrieval or disk backup.
  • You can do the following with S3 buckets through the APIs:
  • Create, edit, or delete existing buckets
  • Upload new objects to a bucket and download them
  • Search for and find objects and buckets
  • Find metadata associate with objects and buckets
  • Specify where a bucket should be stored
  • Make buckets and objects available for public access
  • Versioning option is available for Amazon S3.
  • With versioning feature is enabled, every version of an object stored in an S3 bucket is retained.
  • Versioning is used for preserving data and fo
  • r archiving purposes.
  • Amazon S3 provides large quantities of reliable storage that is highly protected but to which you have low bandwidth access.
  • S3 excels in applications where storage is archival in nature.

Best used for

  • Static web content and media.
  • Hosting entire static websites.
  • Data store for computation and large-scale analytics, such as analyzing financial transactions, clickstream analytics, and media transcoding.
  • Secure solution for backup and archival of critical data.
  • Disaster recovery solutions for business continuity.

Not good for

  • Structured data with a query.
  • Rapidly changing data.
  • Long-term encrypted archival storage with infrequent read access.
  • Dynamic website hosting.

Performance

  • Access to Amazon S3 from within Amazon EC2 in the same region is fast.
  • Designed so that server-side latencies are insignificant relative to Internet latencies.
  • Built to scale storage, requests, and users to support a virtually unlimited number of web-scale applications

Amazon Elastic Block Store (EBS)

  • EBS create virtual drives that can be used with your machine instances in the same way that you would use a hard drive with a physical system.
  • EBS tends to be used in transactional systems where high-speed data access is required.
  • A persistent storage service with a high operational performance.
  • It can store file system information and its performance is higher and much more reliable than Amazon S3.
  • The cost of creating an EBS volume is greater than creating a similarly sized S3 bucket.
  • An EBS volume can be used as an instance boot partition.
  • The advantages of an EBS boot partition:
  • Can have a volume up to 1 TB.
  • Retain your boot partition separately from your EC2 instance.
  • Use a boot partition volume as a means for bundling an AMI into a single package.
  • EBS boot partitions can be stopped and started.
  • They offer fast AMI boot times.
  • EBS create block storage volumes varying in size from 1GB to 1TB and make those volumes available to your machine instances.
  • The created volumes must be formatted for use.
  • A volume is mounted on a particular instance and is available only to that instance; i.e, volumes may not be shared between instances.
  • Volumes appear as if they are physical drives attached to an instance.
  • Multiple volumes can be mounted on a single instance and create striped RAID volumes for faster performance.
  • You can make an instance image or snapshot of your AMI, and these point-in-time snapshots are then copied out to Amazon S3.
  • You can use these snapshots as system images to create new AMIs or to restore a volume to that point-in-time snapshot when needed.
  • Snapshots can be shared with authorized users using Snapshot Permissions command.
  • When you create a new volume from an S3 snapshot, the data is slowly copied to the new volume.
  • As you start working on the new volume, any missing data is downloaded preferentially as needed.

Best used for

  • Data that changes relatively frequently and requires long-term persistence.
  • Well-suited for use as primary storage for a database or file system.
  • Applications that require access to raw block-level storage.
  • Amazon EBS Provisioned IOPS volumes are particularly well-suited for use with databases applications that require a high and consistent rate of random disk reads and writes.

Not good for

  • Temporary storage.
  • Highly-durable storage.
  • Static data or web cont

CloudFront

  • CloudFront represents another level of Amazon cloud storage.
  • Amazon CloudFront is referred to as a Content Delivery Network (CDN) or Edge Computing. 
  • In edge computing, content is pushed out geographically so the data is more readily available to network clients and has a lower latency when requested. 
  • CDN is like a distributed caching system. 
  • CloudFront servers are located throughout the world. 
  • A user requesting data from a CloudFront site is referred to the nearest geographical location. 
  • CloudFront supports “geo-caching” data by performing static data transfers and streaming content from one CloudFront location to another.
  • A CloudFront domain name is registered for your domain name in the form <domainname>.cloudfront.net.
  • Objects in the CloudFront domain can be mapped to your own domain. 
  • Source files on CloudNet servers are stored in Amazon S3 buckets and then use the CloudFront API to register the S3 bucket with the CloudNet distribution. 
  • Then in your applications, Web pages, and links, you reference the distribution location.

Amazon Elastic file storage

AWS EFS is a shared, elastic file storage system that grows and shrinks as you add and remove files. It offers a traditional file storage paradigm, with data organized into directories and subdirectories. EFS is useful for SaaS applications and content management systems. You can mount EFS onto several EC2 instances at the same time

Amazon storage: Glacier

Amazon Glacier is an extremely low-cost Amazon storage service that provides highly secure, durable, and flexible storage for data backup and archival.
Best used for

  • Off-site enterprise stores.
  • Media assets.
  • Research and scientific data.
  • Digital preservation.
  • Magnetic tape replacement.

Not good for

  • Rapidly changing data.
  • Real-time access.

Performance

  • Slow.
  • Jobs typically complete in 3 to 5 hours.

Leave a reply