AWS Storage Tutorial

Amazon S3

Learn Amazon S3 and understand buckets, objects, storage classes, permissions, versioning, lifecycle management, and cloud object storage.

Level: Beginner

Service: Amazon S3

Start Learning AWS Tutorials

S3 Learning Path

Learn AWS Object Storage

Understand S3 Buckets

Work with S3 Objects

Choose Storage Classes

Configure Access and Security

Manage Versioning and Lifecycle Rules

Introduction

What is Amazon S3?

Amazon Simple Storage Service, commonly known as Amazon S3, provides cloud object storage for storing and retrieving data.

Data in Amazon S3 is organized into buckets, and the files or data stored inside those buckets are called objects.

Amazon S3 can be used for application assets, backups, logs, documents, media files, static website content, data storage, and many other cloud workloads.

Core Concepts

S3 fundamentals every beginner should understand

Understanding buckets, objects, storage classes, and access controls provides the foundation for working with Amazon S3.

S3 Buckets

An Amazon S3 bucket is a container used to store objects. Before storing data in Amazon S3, you create a bucket and upload objects into it.

Key Topics

• Bucket names
• AWS Regions
• Object storage
• Bucket configuration

S3 Objects

An object is the data stored in an S3 bucket. Objects can include files such as documents, images, videos, backups, logs, and application assets.

Key Topics

• Object keys
• Files
• Metadata
• Object versions

Storage Classes

Amazon S3 provides multiple storage classes designed for different access patterns, availability requirements, and data lifecycle needs.

Key Topics

• Frequent access
• Infrequent access
• Intelligent tiering
• Archive storage

Security and Access

S3 access can be controlled using AWS IAM, bucket policies, access controls, encryption, and other security configurations.

Key Topics

• IAM policies
• Bucket policies
• Block Public Access
• Encryption

S3 Architecture

How data is organized in Amazon S3

Applications and users interact with Amazon S3 through AWS services, the AWS Management Console, APIs, SDKs, or the AWS CLI.

Access to buckets and objects should be controlled using appropriate AWS permissions and security configurations.

Simplified S3 Architecture

Application
     │
     ▼
┌──────────────────┐
│   AWS Identity   │
│   Permissions    │
└──────────────────┘
     │
     ▼
┌──────────────────┐
│    S3 Bucket     │
│                  │
│  ┌────────────┐  │
│  │ Object 1   │  │
│  ├────────────┤  │
│  │ Object 2   │  │
│  ├────────────┤  │
│  │ Object 3   │  │
│  └────────────┘  │
│                  │
└──────────────────┘

Create a Bucket

Basic Amazon S3 setup workflow

Creating an S3 bucket involves selecting a name, Region, and appropriate security and data management settings.

Step 1

Choose a Bucket Name

Create a globally appropriate bucket name that follows Amazon S3 naming requirements and does not contain sensitive information.

Step 2

Select an AWS Region

Choose the AWS Region where the bucket and its objects will be stored.

Step 3

Configure Object Ownership

Configure ownership and access settings according to your application and organization requirements.

Step 4

Configure Public Access

Keep unnecessary public access blocked and only allow access that is explicitly required.

Step 5

Configure Versioning

Enable versioning when you need to retain multiple versions of objects and improve recovery from accidental overwrites or deletions.

Step 6

Upload Objects

Upload files and data into the bucket using the AWS Console, AWS CLI, SDKs, or other supported tools.

Storage Classes

Choose storage based on access requirements

Amazon S3 provides multiple storage classes for different data access patterns and lifecycle requirements.

S3 Standard

Designed for frequently accessed data and general-purpose object storage workloads.

S3 Intelligent-Tiering

Designed for data with changing or unpredictable access patterns where automatic storage tier optimization can be useful.

S3 Standard-IA

Designed for data that is accessed less frequently but still requires rapid access when needed.

S3 One Zone-IA

Designed for certain infrequently accessed workloads where data can be stored in a single Availability Zone.

S3 Glacier Instant Retrieval

Designed for archive data that still requires immediate retrieval capabilities.

S3 Glacier Flexible Retrieval

Designed for archive workloads where retrieval time can be more flexible.

S3 Glacier Deep Archive

Designed for long-term data retention and archive workloads with very infrequent access.

Security

Protect your buckets and objects

Amazon S3 resources should be configured with appropriate access permissions. Access can be managed using IAM policies, bucket policies, and other supported access controls.

Public access should only be enabled when it is specifically required for the workload. Sensitive data should not be exposed unnecessarily.

Encryption, access logging, monitoring, and least-privilege permissions are important considerations when designing secure S3 storage.

1Use least-privilege IAM permissions

2Keep unnecessary public access blocked

3Use bucket policies carefully

4Protect sensitive data with appropriate encryption

5Review access and storage configurations regularly

S3 Versioning

Keep multiple versions of your objects

S3 Versioning can retain multiple variants of an object within the same bucket. This can help with recovery from accidental overwrites and certain deletion scenarios.

Versioning is disabled by default and must be explicitly enabled for a bucket when required.

When using versioning, you should also consider lifecycle rules for managing older and noncurrent object versions.

AWS CLI Versioning Commands

# Enable versioning on a bucket

aws s3api put-bucket-versioning \
  --bucket my-example-bucket \
  --versioning-configuration Status=Enabled

# Check versioning configuration

aws s3api get-bucket-versioning \
  --bucket my-example-bucket

# List object versions

aws s3api list-object-versions \
  --bucket my-example-bucket

Lifecycle Management

Manage data throughout its lifecycle

S3 Lifecycle rules can automate transitions between storage classes and perform expiration actions based on configured rules.

Store

Upload and store objects in the appropriate Amazon S3 storage class.

Monitor

Review how data is accessed and determine whether the storage configuration remains appropriate.

Transition

Use lifecycle rules to move eligible objects to another storage class when appropriate.

Expire

Automatically remove objects or versions when they are no longer required, according to configured lifecycle rules.

Example Lifecycle Configuration

{
  "Rules": [
    {
      "ID": "ArchiveOldLogs",
      "Status": "Enabled",
      "Filter": {
        "Prefix": "logs/"
      },
      "Transitions": [
        {
          "Days": 90,
          "StorageClass": "GLACIER"
        }
      ]
    }
  ]
}

AWS CLI S3 Commands

# List available S3 buckets

aws s3 ls

# Create a bucket

aws s3api create-bucket \
  --bucket my-example-bucket \
  --region us-east-1

# Upload a file

aws s3 cp example.txt \
  s3://my-example-bucket/

# List objects

aws s3 ls s3://my-example-bucket/

# Download an object

aws s3 cp \
  s3://my-example-bucket/example.txt \
  ./example.txt

AWS CLI

Manage Amazon S3 from the command line

The AWS Command Line Interface can be used to create buckets, upload objects, download files, list resources, and automate Amazon S3 operations.

AWS CLI commands are useful when working with automation, scripts, deployment workflows, and cloud infrastructure operations.

What You Will Learn

Build your Amazon S3 foundation

Object Storage Fundamentals

Understand how cloud object storage works and how data is organized into buckets and objects.

Storage Management

Learn how storage classes and lifecycle rules can help manage data throughout its lifecycle.

Cloud Security

Understand the importance of IAM permissions, bucket policies, public access controls, and secure storage configuration.

AWS Automation

Learn how to work with S3 using AWS CLI commands and build a foundation for automation and infrastructure workflows.

Continue Learning

Explore more AWS and cloud tutorials

☁️

Start building with Amazon S3

You now understand the core concepts behind Amazon S3. Continue exploring AWS services and build practical cloud storage projects.

Explore AWS Tutorials Cloud Tutorials

Amazon S3

Learn AWS Object Storage

What is Amazon S3?

S3 fundamentals every beginner should understand

S3 Buckets

S3 Objects

Storage Classes

Security and Access

How data is organized in Amazon S3

Basic Amazon S3 setup workflow

Choose a Bucket Name

Select an AWS Region

Configure Object Ownership

Configure Public Access

Configure Versioning

Upload Objects

Choose storage based on access requirements

S3 Standard

S3 Intelligent-Tiering

S3 Standard-IA

S3 One Zone-IA

S3 Glacier Instant Retrieval

S3 Glacier Flexible Retrieval

S3 Glacier Deep Archive

Protect your buckets and objects

Keep multiple versions of your objects

Manage data throughout its lifecycle

Store

Monitor

Transition

Archive

Expire

Manage Amazon S3 from the command line

Build your Amazon S3 foundation

Object Storage Fundamentals

Storage Management

Cloud Security

AWS Automation

Explore more AWS and cloud tutorials

AWS for Beginners

Amazon EC2

Cloud Infrastructure

Start building with Amazon S3