Simple Storage Service (S3)

  1. Simple scalable key value Object storage on cloud
  2. Limits
    1. The total volume of data and number of objects you can store are unlimited.
    2. Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 terabytes.
    3. The largest object that can be uploaded in a single PUT is 5 gigabytes.
    4. For objects larger than 100 megabytes, use Multipart Upload preferably.
    5. Multi-Object Delete API: delete upto 1000 objects: single HTTP request.
  3. Objects are stored in Buckets as key value pairs
    1. Bucket has unique global name
    3. arn:aws:s3:::bucket/resourcekey
    4. key: Folder1/hello.html value: the content of that file
    5. Also objects contain metadata and optional version number
  4. Data Consistency
    1. Read after Write consistency for new PUTs (Immediate)
    2. Eventual consistency for DELETE and Overwrite PUT (may take some time)
  5. The data are stored lexicographical/sorted alphabetically
    1. For performance, save objects of random names (add salt before filename if its based on timestamp)
  6. Tiered Storage
    S3 storage classes comparision

    1. Standard
      1. Availability 99.99% (4 nines)
      2. Durability 99.999999999 (11 nines)
    2. Infrequent access
      1. Cheaper than S3 standard but retrieval fee is charged
      2. 99.9 (3 nines) availability
    3. Reduced Redundancy Storage
      1. Availability 99.99% (4 nines)
      2. Durability 99.99% also
    4. Glacier class
      1. Cheap but takes 4 hours to retrieve
  7. Life-cycle Management
  8. Versioning
  9. Access Control Lists and bucket policies
  10. S3 is AWS object storage service on the cloud. Lets you store key/value pairs (bucket name, filename is key the content of the object/file is value)
  11. S3 access is global but a bucket will need a region
  12. Encryption
    1. Client side encryption
    2. Server Side encryption
      1. SSE-S3 using S3 managed Keys
      2. SSE-KMS using KMS keys
      3. SSE-C using client provided keys
  13. Security
    1. Control access to a bucket using bucket ACL or bucket policy
  14. All buckets and objects are pvt by default
  15. Two ways to stop people from accidentally delete objects
    1. Enable versioning
    2. Enable MFA delete
  16. Cross region replication
    1. You need to first turn versioning
    2. Then goto Management and choose cross region replication
    3. create rule to replicate all or some objects to a destination bucket.
    4. You can specify a different storage class for the replication target bucket
    5. Only new objects (not the existing ones) are replicated
  17. S3 transfer acceleration
    1. Lets you copy files to cloud front edge location as opposed to directly copying to s3 bucket thus saving time/latency since the edge location is closer to you than the S3 bucket
  18. Static website hosting on S3
    1. Create a bucket whose name is same as your domain name (without .com)
    2. Go to static website hosting and enable
    3. Grant public read access
    4. URL will be where region can be us-east-1 etc.
  19. S3 is global but buckets reside in regions. But no need to provide region in url or arn since they are globally unique
  20. Requester Pays Option: Can be used to pass on request/transfer costs to another AWS account
  21. Events: Can be enabled to receive notifications when specific events occur in your bucket
  22. Optimizing S3 performance:If you consistently exceed 100+ PUT/DELETEs or 300+ GETS, you should optimize your S3.
    1. For GET only performance use CloudFront
    2. For PUT/DELETE performance use a hexadecimal hash as the prefix. This will force S3 to use different bucket partitions which will enhance performance
      • examplebucket/232a2013-26-05-15-00-00/cust123423/photo1.jpg
      • examplebucket/7b542013-26-05-15-00-00/cust385742/photo2.jpg
      • examplebucket/921c2013-26-05-15-00-00/cust124843/photo2.jpg
      • examplebucket/ba652013-26-05-15-00-00/cust874937/photo2.jpg
<<< Network Address Translation (NAT) Instances, NAT Gateways, Egress only Internet Gateways and Bastion HostsCloud Watch Metrics >>>
Copyright 2005-2016 KnowledgeHills. Privacy Policy. Contact .