FreeSBC:Uploading backups to AWS S3 - Revision history

Serdar Civici: /* Using the AWS CLI with Amazon S3 */

2020-12-17T09:34:54Z

Using the AWS CLI with Amazon S3

Serdar Civici at 09:32, 17 December 2020

2020-12-17T09:32:15Z

Serdar Civici: /* Using the AWS CLI with Amazon S3 */

2020-12-17T09:26:39Z

Using the AWS CLI with Amazon S3

Serdar Civici at 09:26, 17 December 2020

2020-12-17T09:26:03Z

Serdar Civici at 09:09, 17 December 2020

2020-12-17T09:09:53Z

Serdar Civici at 09:07, 17 December 2020

2020-12-17T09:07:36Z

Serdar Civici at 09:06, 17 December 2020

2020-12-17T09:06:54Z

Serdar Civici: Created page with "In this tutorial, we are going to help you use the AWS Command Line Interface (CLI) to access Amazon S3. We will do this so you can easily build your own scripts for backing u..."

2020-12-17T09:03:59Z

Created page with "In this tutorial, we are going to help you use the AWS Command Line Interface (CLI) to access Amazon S3. We will do this so you can easily build your own scripts for backing u..."

New page

In this tutorial, we are going to help you use the AWS Command Line Interface (CLI) to access Amazon S3. We will do this so you can easily build your own scripts for backing up your files to the cloud and easily retrieve them as needed.

== Create an AWS IAM User ==

In this step, using the IAM service you will create a user account with administrative permission. In later steps, you will use this user account to securely access AWS services using the AWS CLI.

1. Please login to the AWS management console with your user name and password. Then type IAM in the search bar and select IAM to open the Identity and Access Management dashboard.

[[Image:AWS_IAM_1.png|600px| ]]

2. From the AWS Identity and Access Management dashboard, click on Users on the left side.

[[Image:AWS_IAM_2.png|600px| ]]

3. Click the Add user button.

[[Image:AWS_IAM_3.png|600px| ]]

4. Enter a user name in the textbox next to User name: (we’ll use AWS_Admin for this example) and select Programmatic access in the Select AWS Access Type section. Click the Next: Permissions button.

[[Image:AWS_IAM_4.png|600px| ]]

5. Click on Attach existing policies directly option. Select AdministratorAccess then click Next: Review.

[[Image:AWS_IAM_5.png|600px| ]]

6. Click on Create user.

[[Image:AWS_IAM_6.png|600px| ]]

7. Click the Download Credentials button and save the credentials.csv file in a safe location (you’ll need this later) and then click the Close button.

[[Image:AWS_IAM_6.png|600px| ]]

== Install and Configure the AWS CLI ==

Now that you have your IAM user, you need to install the AWS Command Line Interface (CLI).

1. For the latest version of the AWS CLI, use the following command block:

$ curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install

2. Confirm the installation.

aws --version
aws-cli/2.1.12 Python/3.7.3 Linux/3.10.0-1127.18.2.el7.tb.x86_64 exe/x86_64.centos.7 prompt/off

@@ Line 89: / Line 89: @@
 <pre> aws s3 rm s3://my-first-backup-bucket/my-first-backup.bak </pre>
-[[Image:AWS_CLI_4.png|600px| ]]
+[[Image:AWS_CLI_5.png|600px| ]]
 . You can find script examples for automatic and scheduling uploads. Please check the following link;
 * [https://gist.github.com/chrismdp/6c6b6c825b07f680e710 Uploading to S3 in 18 lines of Shell]

← Older revision		Revision as of 09:26, 17 December 2020
Line 93:		Line 93:
	5. You can find script examples for automatic and scheduling uploads. Please check the following link;		5. You can find script examples for automatic and scheduling uploads. Please check the following link;

−	[https://gist.github.com/chrismdp/6c6b6c825b07f680e710 Uploading to S3 in 18 lines of Shell]	+	* [https://gist.github.com/chrismdp/6c6b6c825b07f680e710 Uploading to S3 in 18 lines of Shell]

← Older revision		Revision as of 09:26, 17 December 2020
Line 56:		Line 56:
	Default region name [None]: enter us-east-1		Default region name [None]: enter us-east-1
	Default output format [None]: enter json</pre>		Default output format [None]: enter json</pre>
		+
		+	[[Image:AWS_CLI_1.png\|600px\| ]]
		+
		+	== Using the AWS CLI with Amazon S3 ==
		+
		+	In this step, you will use the AWS CLI to create a bucket in S3 and copy a file to the bucket.
		+
		+	1. Creating a bucket is optional if you already have a bucket created that you want to use. To create a new bucket named my-first-backup-bucket type:
		+
		+	<pre> aws s3 mb s3://my-first-backup-bucket </pre>
		+
		+	Note: bucket naming has some restrictions; one of those restrictions is that bucket names must be globally unique (e.g. two different AWS users can not have the same bucket name); because of this, if you try the command above you will get a BucketAlreadyExists error.
		+
		+	[[Image:AWS_CLI_2.png\|600px\| ]]
		+
		+	2. To upload the file my first backup.bak located in the local directory (C:\users) to the S3 bucket my-first-backup-bucket, you would use the following command:
		+
		+	<pre>aws s3 cp “C:\users\my first backup.bak” s3://my-first-backup-bucket/</pre>
		+
		+	Or, use the original syntax if the filename contains no spaces.
		+
		+	[[Image:AWS_CLI_3.png\|600px\| ]]
		+
		+	3. To download my-first-backup.bak from S3 to the local directory we would reverse the order of the commands as follows:
		+
		+	<pre> aws s3 cp s3://my-first-backup-bucket/my-first-backup.bak ./ </pre>
		+
		+	[[Image:AWS_CLI_4.png\|600px\| ]]
		+
		+	4. To delete my-first-backup.bak from your my-first-backup-bucket bucket, use the following command:
		+
		+	<pre> aws s3 rm s3://my-first-backup-bucket/my-first-backup.bak </pre>
		+
		+	[[Image:AWS_CLI_4.png\|600px\| ]]
		+
		+	5. You can find script examples for automatic and scheduling uploads. Please check the following link;
		+
		+	[https://gist.github.com/chrismdp/6c6b6c825b07f680e710 Uploading to S3 in 18 lines of Shell]

@@ Line 45: / Line 45: @@
 . Confirm the installation.
-<pre> aws --version
+<pre>aws --version
 aws-cli/2.1.12 Python/3.7.3 Linux/3.10.0-1127.18.2.el7.tb.x86_64 exe/x86_64.centos.7 prompt/off </pre>

@@ Line 40: / Line 40: @@
 <pre> $ curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip" </pre>
-unzip awscliv2.zip
+<pre> unzip awscliv2.zip </pre>
-sudo ./aws/install
+<pre> sudo ./aws/install </pre>
 . Confirm the installation.
-aws --version
+<pre> aws --version
-aws-cli/2.1.12 Python/3.7.3 Linux/3.10.0-1127.18.2.el7.tb.x86_64 exe/x86_64.centos.7 prompt/off
+aws-cli/2.1.12 Python/3.7.3 Linux/3.10.0-1127.18.2.el7.tb.x86_64 exe/x86_64.centos.7 prompt/off </pre>

@@ Line 31: / Line 31: @@
 . Click the Download Credentials button and save the credentials.csv file in a safe location (you’ll need this later) and then click the Close button.
-[[Image:AWS_IAM_6.png|600px| ]]
+[[Image:AWS_IAM_7.png|600px| ]]
 == Install and Configure the AWS CLI ==