S3 Bucket - Copy, Sync, & Delete

Effectively managing S3 Buckets, including copying files, syncing data between buckets, and emptying or deleting redundant ones, is crucial for data integrity and storage optimization. Copying files ensures redundancy and disaster recovery, while synchronization maintains data consistency across environments. Proper handling of unused data by emptying or deleting unnecessary buckets reduces storage costs and supports optimal AWS infrastructure performance, enhancing overall efficiency and business continuity.

Step 1: Copying a file to another S3 Bucket

First, have two S3 buckets set up. In this example, we have a source bucket and a destination bucket. The example source bucket contains 3 files - index.html, style.css, and avatarmaker.png. The destination bucket will be empty.

From the AWS Console, launch the AWS CloudShell. To copy the style.css file to the desination bucket, we must use this command: aws s3 cp s3://testbucket-source1231/style.css s3://testbucket-destination1231/style.css

style.css can now be found in the destination bucket!

Step 2: Syncing/Copying all files to another S3 Bucket

Now lets copy the rest of the files to the destination bucket! To do this, use this command: aws s3 sync s3://testbucket-source1231 s3://testbucket-destination1231

If done correctly, index.html and avatarmaker.png both will get copied to the destination bucket.

Step 3: Emptying an S3 Bucket

After syncing/copying the files to the destination bucket, the source bucket bucket can now be emptied and deleted. The bucket must be emptied before it can be deleted, enter this command: aws s3 rm s3://testbucket-source1231 --recursive

If done correctly, the source bucket should be completely emptied!

Step 4: Deleting an S3 Bucket

Now, lets delete the emptied source bucket. Enter command: aws s3 rb s3://testbucket-source1231

Congratulations! All files within the source bucket and the bucket itself should be now deleted. Previous files from the source bucket should be in the destination bucket.

Reference

Copy file to another bucket: aws s3 cp s3://source-bucket/example.txt s3://destination-bucket/example.txt

Sync/Copy Entire bucket: aws s3 sync s3://source-bucket s3://destination-bucket

Empty bucket: aws s3 rm s3://bucket-name --recursive

Delete bucket: aws s3 rb s3://bucket-name