AWS Storage aka S3 Overview

AWS S3

S3 – Object based storage (Photos,videos e.g)

0- 5TB file size

unlimited storage

Files are stored in buckets – (equivalent to folder)

S3 is universal namespace, i.e names are unique

https://s3-us-west.amazonaws.com/anujtomar

-Key – name of object

-value – data

-version id

-metadata

-subresources –

    • ACL
    • Torrent
  • S3 – 99.99 availability, 99.99999999999 % durability, stored redundantlycan sstain 2 site failure
  • S3 – IA – Infrequent access 99.9 availabilty, lower fees than s3 but charged retriveal fee
  • Reduced redundancy storage – 99.99 durability & 99.99 availability
  • Glacier – Very cheap, used for archival takes 3-5 hours to restore from glacier

S3 Charges:

  • Storage
  • Requests
  • Storage Mgt Pricing
  • Data transfer pricing
  • Transfer acceleation
Read S3 FAQ Before exam:

S3 – versioning

– stores all version even if u delete the same

– once enabled versioning can’t be disabled, only be suspended

integrate with lifecycle rules

S3 – Cross Region Replication:

– versioning should be enabled on both buckets

  • old objects before enabling cross replication will not be replicated
  • New objects will only be replicated
  • if u update old version it will replicate all version
  • permissions are replicated
  • Regions must be unique
  • delete markers are replicated – kind of invisible cloak, objects still there
  • deleting individual versions or delete markers will not be replicated – u need to delete those manually

It appears the Cross-Region Replication in Amazon S3 cannot be chained. Therefore, it cannot be used to replicate from Bucket A to Bucket B to Bucket C.

An alternative would be to use the AWS Command-Line Interface (CLI) to synchronise between buckets, eg:

aws s3 sync s3://bucket1 s3://bucket2 
aws s3 sync s3://bucket1 s3://bucket3

The sync command only copies new and changed files. Data is transferred directly between the Amazon S3 buckets, even if they are in different regions — no data is downloaded/uploaded to your own computer.

Leave a Reply