AWS : S3 (Simple Storage Service) VII - Cross-Region Replication, how to Copy or Move Objects from one region to another

bogotobogo.com site search:

Note

In this tutorial, we'll learn how to copy or move S3 Objects from one region to another. We'll use Cross-Region Replication for the case when the source and destination buckets are owned by the same AWS account.

We'll assume we already owned one bucket (source). So, we need to create another bucket (destination) in a different AWS region, enable versioning on both the buckets, and then configure cross-region replication on the source bucket.

Once enabled, new objects uploaded to a particular S3 bucket are automatically replicated to a designated destination bucket located in a different AWS region. The replication process also copies any metadata and ACLs (Access Control Lists) associated with the object and can be enabled and managed through the S3 API.

Existing objects will not be replicated. Cross-Region Replication replicates every future upload of every object to another bucket.

Configure Cross-Region Replication

Cross-region replication is the automatic, asynchronous copying of objects across buckets in different AWS regions. By activating cross-region replication, Amazon S3 will replicate newly created objects, object updates, and object deletions from a source bucket into a destination bucket in a different region. Cross-region replication has specific requirements that define what can and cannot be replicated across regions based on how the object is created and how it is encrypted.

How to configure Cross-Region Replication (Source and Destination Buckets Owned by the Same AWS Account)?

See Configure Cross-Region Replication (Source and Destination Buckets Owned by the Same AWS Account).

Destination bucket

Create a destination bucket in another AWS region, say, Tokyo:

Enable versioning on the bucket, we can get the menu by clicking on the Properties icon on the left of the bucket name:

Enable cross-region replication

Enable cross-region replication on the source bucket. We can decide if we want to replicate all objects or only objects with a specific prefix.

In the Properties pane, click Cross-Region Replication.

Choose the Source-either the entire bucket or a prefix within the bucket.
Choose the Destination Region from the drop-down list.
Choose the Destination Bucket if we do not see our desired destination bucket in the list, confirm that the bucket exists in the region we selected above, and that we have enabled versioning on that bucket. If no buckets exist in that region, and we click Create a new bucket from the dropdown list, we'll be prompted to create a new bucket with versioning enabled in that destination region.
In order to perform cross-region replication of objects on our behalf, Amazon S3 will need to use an IAM role that we have created. Click Create/Select IAM Role and a new browser tab will open up within the AWS Identity and Access Management (IAM) console. On that page, we'll select an existing IAM role or create a new one that will allow Amazon S3 to replicate objects from the source bucket to the destination bucket on our behalf. By default, Amazon S3 will generate a policy document for the IAM role that matches the source and destination buckets we've chosen. To continue, click Allow to return to the Amazon S3 console.
Click Save.

Test

Now we want to verify that Amazon S3 replicated the objects in the destination bucket.

Time it takes for Amazon S3 to replicate an object depends on the object size.

Also, note that "Existing objects will not be replicated. Cross-Region Replication replicates every future upload of every object to another bucket."