Source:Backup to S3 Cloud Storage: Difference between revisions

From SEPsesam
m (Sta moved page Si3 NG Direct to S3 to 5 0 0:Si3 NG Direct to S3 without leaving a redirect)
No edit summary
(26 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<noinclude><div class="noprint"><languages />
<noinclude><translate><!--T:1-->
<div class="noprint"><languages />
{{Copyright SEP AG en}}
{{Copyright SEP AG en}}
{{draft}}
{{draft}}


{{Navigation_latest|release=[[SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']]|link=[[Special:MyLanguage/Si3_Deduplication|documentation archive]]}}</div><br />
<!--T:2-->
===Overview===
{{Navigation_latest|release=[[SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']]|link=[[Special:MyLanguage/Si3_Deduplication|documentation archive]]}}</div></translate><br />
<translate>===Overview=== <!--T:100--></translate>
<div class="boilerplate metadata" id="Additional resources" style="background-color: #f0f0f0; color:#636f73; border: 1px ridge #cdd3db; margin: 0.5em; padding: 0.5em; float: right; width: 35%; "><center><b>
<div class="boilerplate metadata" id="Additional resources" style="background-color: #f0f0f0; color:#636f73; border: 1px ridge #cdd3db; margin: 0.5em; padding: 0.5em; float: right; width: 35%; "><center><b>
Additional resources</b></center>
<translate><!--T:101--> Additional resources</translate></b></center>


{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_next.png|45px|link=http://www.sep.de/products/deduplication/deduplication-analysis/#_]]
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_next.png|45px|link=http://www.sep.de/products/deduplication/deduplication-analysis/#_]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
See also: [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/Deduplication|Deduplication]] – [[Special:MyLanguage/Source_Side_Dedup|Configuring Source-side Deduplication]] – [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] – [[Special:MyLanguage/Licensing|Licensing]]
<translate><!--T:3--> See also: [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/Encrypting_Si3_NG_Deduplication_Store|Encrypting Si3 NG Deduplication Store]] – [[Special:MyLanguage/Standard Backup Procedure|Standard Backup Procedure]] – [[Special:MyLanguage/5_0_0:Restore_Assistant|Restore Assistant]] – [[Special:MyLanguage/Standard Restore Procedure|Standard Restore Procedure]] – [[Special:MyLanguage/Licensing|Licensing]]</translate>
|}
|}


{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_Video.png|45px|link=Video Tutorials & Screencasts]]
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_Video.png|45px|link=Video Tutorials & Screencasts]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |Watch SEP sesam video [https://www.youtube.com/watch?v=sSkfmufQkXU Why and how to use Deduplication with SEP sesam].
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |<translate><!--T:4--> Watch SEP sesam video [https://www.youtube.com/watch?v=sSkfmufQkXU Why and how to use Deduplication with SEP sesam].</translate>
|}
|}


{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" |  
| rowspan="2" style="padding:0px 10px 0px;" |  
[[File:SEP Tip.png|45px|link=Special:MyLanguage/FAQ|FAQ]]
[[File:SEP Tip.png|45px|link=Special:MyLanguage/4_4_3_Beefalo:FAQ|FAQ]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |  
Check [[Special:MyLanguage/FAQ|FAQ]] to find the answers to most common questions.
<translate><!--T:5--> Check [[Special:MyLanguage/4_4_3_Beefalo:FAQ|FAQ]] to find the answers to most common questions.</translate>
|}
|}


Line 29: Line 31:
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP Troubleshooting.png|45px|link=Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication]]
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP Troubleshooting.png|45px|link=Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |
Problems? Check the [[Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication|Troubleshooting Guide]].
<translate><!--T:6--> Problems? Check the [[Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication|Troubleshooting Guide]].</translate>
|}</div></noinclude>
|}</div></noinclude>


<translate><!--T:7-->
SEP sesam v. [[SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']] has introduced a new generation Si3 data store: Si3 NG. It enables you to back up your data directly to the S3 (Simple Storage Solution) cloud storage and restore the items you want directly from there. After an initial full backup of your virtual and physical environment, you can use any [[Special:MyLanguage/SEP_sesam_Glossary#backup_level|backup level]] (including differential and incremental backups) to back up only new data to the cloud.
SEP sesam v. [[SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']] has introduced a new generation Si3 data store: Si3 NG. It enables you to back up your data directly to the S3 (Simple Storage Solution) cloud storage and restore the items you want directly from there. After an initial full backup of your virtual and physical environment, you can use any [[Special:MyLanguage/SEP_sesam_Glossary#backup_level|backup level]] (including differential and incremental backups) to back up only new data to the cloud.


Si3 NG offers significantly improved performance for backup, restore and migration, resulting in improved performance, scaling and resource savings. For a comparison of the two deduplication stores, see the section [[Si3_NG_Direct_to_S3#comparison|Comparison of Si3 and Si3 NG]] below.
<!--T:8-->
Si3 NG offers significantly improved performance for backup, restore and migration, resulting in improved performance, scaling and resource savings. For a comparison of the two deduplication stores, see the section [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#comparison|Comparison of Si3 and Si3 NG]] below.


==== Powerful restore ====
==== Powerful restore ==== <!--T:9-->


The new Si3 NG can detect duplicate data fragments to streamline the restore process. Use the [[Special:MyLanguage/5_0_0:Restore_Assistant|Web Restore Assistant]] or [[Special:MyLanguage/4_4_3_Beefalo:Standard_Restore_Procedure|GUI Restore Wizard]] to instantly restore your data from backups. Restoring a single file is easy as you can use the search function to find the desired backup and start the restore process to the original location or a different machine.  
<!--T:10-->
The new Si3 NG can detect duplicate data fragments to streamline the restore process. Use the [[Special:MyLanguage/5_0_0:Restore_Assistant|Web Restore Assistant]] or [[Special:MyLanguage/4_4_3_Beefalo:Standard_Restore_Procedure|GUI Restore Wizard]] to instantly restore your data from backups. Restoring a single file is easy as you can use the search function to find the desired backup and start the restore process to the to the original or another location.  


Si3 NG uses S3 in the same way as local storage, allowing you to use your S3 cloud storage to securely store and retrieve your business data anytime, anywhere. [[Special:MyLanguage/Encrypting_Si3_Deduplication_Store|Data encryption]] and [[Special:MyLanguage/Seeding_Si3_Deduplication_Store|seeding Si3 deduplication store]] are not currently supported (see the [[Si3_NG_Direct_to_S3#comparison|Si3 and Si3 NG comparison]] section below).
<!--T:11-->
Si3 NG uses S3 in the same way as local storage, allowing you to use your S3 cloud storage to securely store and retrieve your business data anytime, anywhere.


==== Multiple media pools ====
==== Multiple media pools ==== <!--T:12-->
With Si3 NG, you can create multiple [[Special:MyLanguage/Configuring_a_Media_Pool|media pools]] to provide scalability and granularity of backup jobs.  You can create separate media pools, e.g., for daily differential and incremental and weekly full backup jobs, or for migration and replication, and you can set a different retention time for each media pool.


=={{anchor|configuration}}Configuring Si3 NG S3 store==
<!--T:13-->
Si3 NG lets you create multiple [[Special:MyLanguage/Configuring_a_Media_Pool|media pools]] to provide scalability and granularity of backup jobs. You can create separate media pools, e.g., for daily differential and incremental and weekly full backup jobs, or for migration and replication, and you can set a different retention time for each media pool.</translate>


SEP sesam enables you to back up your data directly to S3 cloud storage using ''Si3 NG deduplication store''. The procedure consists of the following steps:
=== {{anchor|object_storage}}<translate><!--T:14--> SEP sesam support for S3-compatible cloud and blob storage </translate>===


# [[Special:MyLanguage/Si3_NG_Direct_to_S3#bucket|Create a bucket]]
<translate><!--T:15-->
# [[Special:MyLanguage/Si3_NG_Direct_to_S3#user|Create a new backup user]]
With Si3 NG, you can '''back up your data directly to the S3 cloud''' and (from [[SEP sesam Release Versions|Jaglion V2]]) to '''Microsoft Azure'''. As S3 is an open API standard and AWS Simple Storage Service is a sample implementation of the standard, '''SEP sesam Si3 NG can also be used with other S3-compatible cloud implementations'''. The configuration and management of Si3 NG in an S3-compatible cloud implementation is similar to the example shown in this article and must follow the same process and rules provided for using Si3 NG with S3.</translate>
# [[Special:MyLanguage/Si3_NG_Direct_to_S3#Si3_store|Configure the Si3 NG deduplication store]]
<br /><translate><!--T:16-->
# [[Special:MyLanguage/Si3_NG_Direct_to_S3#media_pool|Configure media pools]]
Note, however, that some S3-compatible cloud environments have not yet been validated by SEP and may not work in some cases. You are solely responsible for the use of SEP sesam in a non-S3 compatible cloud environment and agree that SEP shall not be responsible for it. For the list of supported object storage, see the [[5_0_0:SEP_sesam_OS_and_Database_Support_Matrix#ObjectStorage|support matrix]].
# [[Special:MyLanguage/Si3_NG_Direct_to_S3#bck|Configure backups]]


=== {{anchor|bucket}}Creating a bucket ===
==== Updating Si3 NG on S3 from 5.0.0.4 to the new version ==== <!--T:17-->


Sign-up for S3 and create a bucket (container) where every object in S3 is stored. The term bucket is used to describe the container for backup data.
<!--T:18-->
#Sign in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/
If you use Si3 NG on S3 and update from 5.0.0.4 to the new version, the structure of the existing stores will change as the structure of Si3 NG on S3 is automatically recreated (this includes recreating the index after the renaming). Example:</translate>
#Select ''Create bucket'' and enter all required information. Follow the Amazon Simple Storage Service instructions in [https://docs.aws.amazon.com/AmazonS3/latest/gsg/CreatingABucket.html Creating a Bucket].
*<translate><!--T:19--> The S3 bucket is called ''seps3'', the Si3 NG deduplication store name is ''newNG''. The S3 structure with version 5.0.0.4 of NG is: seps3/pages; seps3/pages-trash; seps3/objects-trash.</translate>
*<translate><!--T:20-->
When updating to the next version of NG, the structure changes to: seps3/newNG/pages; seps3/newNG/pages-trash; seps3/newNG/objects-trash. During this renaming, the Si3 NG service is not available.</translate>


=== {{anchor|user}}Creating a new backup user ===
=={{anchor|configuration}}<translate><!--T:21--> Configuration of Si3 NG S3 store</translate>==
<ol><li>On S3, configure an AWS identity and IAM (Access Management user ''<user_name>'' with administrative user rights. Sign in to the [https://signin.aws.amazon.com/signin?redirect_uri=https%3A%2F%2Fconsole.aws.amazon.com%2Fiam%2F%3Fstate%3DhashArgs%2523%26isauthcode%3Dtrue&client_id=arn%3Aaws%3Aiam%3A%3A015428540659%3Auser%2Fiam&forceMobileApp=0&code_challenge=DAH38FuL9H2Ykm7HETbfqRg8hZxFlNoS1YQi5KfLDQM&code_challenge_method=SHA-256 IAM console] as the account owner by selecting ''Root user'' and providing your AWS account email address.  
 
<br />Follow the recommendation and use your root user credentials only to create your IAM admin user. For details, see [https://docs.aws.amazon.com/IAM/latest/UserGuide/getting-started_create-admin-group.html Creating an Administrator IAM User and Group].
<translate><!--T:22-->
</li>
SEP sesam enables you to back up your data directly to S3 cloud storage using ''Si3 NG deduplication store''. This procedure contains only the basic steps. For details on Amazon S3 storage configuration, see the [https://docs.aws.amazon.com/s3/index.html Amazon Simple Storage Service Documentation].
<li>Create the same user ''<user_name>'' with the same password on the backup server.</li>
 
<li>Log in as ''Administrator'' with the user type ''superuser'' and add the newly created user to the ''Administrators'' group. For details, see [[Special:MyLanguage/Configuring_Database-Based_Authentication|Configuring Database-Based Authentication]].</li></ol>
<!--T:102-->
{{Note|The S3 credentials are stored encrypted (not in plain text) in the ''ini'' file.}}
# [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#bucket|Create a bucket]]
# [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#user|Create a new backup user]]
# [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#Si3-NG|Configure the Si3 NG deduplication store]]
# [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#media_pool|Configure media pools]]
# [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#bck|Configure backups]]</translate>
 
=== {{anchor|bucket}}<translate><!--T:23--> Create a bucket</translate> ===
 
<translate><!--T:24-->
Sign-up for S3 and create a bucket (container) where every object in S3 is stored. The term bucket is used to describe the container for backup data.</translate>
#<translate><!--T:25--> Sign in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/</translate>
#<translate><!--T:26-->
Select ''Create bucket'' and enter all required information. Follow the ''Amazon Simple Storage Service instructions'': [https://docs.aws.amazon.com/AmazonS3/latest/gsg/CreatingABucket.html Creating a Bucket].</translate>
 
=== {{anchor|user}}<translate><!--T:27--> Create a new backup user</translate>===
<translate><!--T:28--> On S3, configure an AWS identity and IAM (Access Management user ''<user_name>'' with administrative user rights. Sign in to the [https://signin.aws.amazon.com/signin?redirect_uri=https%3A%2F%2Fconsole.aws.amazon.com%2Fiam%2F%3Fstate%3DhashArgs%2523%26isauthcode%3Dtrue&client_id=arn%3Aaws%3Aiam%3A%3A015428540659%3Auser%2Fiam&forceMobileApp=0&code_challenge=DAH38FuL9H2Ykm7HETbfqRg8hZxFlNoS1YQi5KfLDQM&code_challenge_method=SHA-256 IAM console] as the account owner by selecting ''Root user'' and providing your AWS account email address.</translate>
<br /><translate><!--T:29--> Follow the recommendation and use your root user credentials only to create your IAM admin user. For details, see the ''AWS Identity and Access Management'' documentation: [https://docs.aws.amazon.com/IAM/latest/UserGuide/getting-started_create-admin-group.html Creating an Administrator IAM User and Group].</translate>
 
{{<translate> <!--T:103--> note</translate>|<translate> <!--T:104-->
AWS access keys consist of an ''access key ID'' and a ''secret access key''. Both keys are required to authenticate access. These credentials are also required to create an Si3 NG data store for S3.  
 
<!--T:105-->
The S3 credentials are stored encrypted (not in plain text) in the ''ini'' file.</translate>}}


==={{anchor|Si3-NG}}Configuring Si3 NG deduplication store===
==={{anchor|Si3-NG}}<translate><!--T:34--> Configure the Si3 NG deduplication store</translate>===


<ol><li>In the '''Main selection''' -> '''Components''', click '''Data Stores''' to display the data store contents frame.
<ol><li><translate><!--T:35--> In the '''Main selection''' -> '''Components''', click '''Data Stores''' to display the data store contents frame.</translate>
<li>From the ''Data Stores'' menu, select '''New Data Store'''. A ''New Data Store'' dialog appears.</li>
<li><translate><!--T:36--> From the ''Data Stores'' menu, select '''New Data Store'''. A ''New Data Store'' dialog appears.</translate></li>
<li>Under ''Data store'' properties, enter a meaningful name for the Si3 NG deduplication store in the '''Name''' field, e.g., Si3-NG-S3. Entering the name also creates the name of the drive group for your Si3 deduplication store in the '''Create new drive group''' field.</li>
<li><translate><!--T:37--> Under ''Data store'' properties, enter a meaningful name for the Si3 NG deduplication store in the '''Name''' field, e.g., Si3-NG-S3. Entering the name also creates the name of the drive group for your Si3 deduplication store in the '''Create new drive group''' field.</translate></li>
<li>From the ''Store type'' drop-down list, select '''SEP Si3 NG Deduplication Store'''.
<li><translate><!--T:38--> From the ''Store type'' drop-down list, select '''SEP Si3 NG Deduplication Store'''.</translate></li>
<li><translate><!--T:39--> Under ''Drive parameter'', leave the options '''Create drive''' and '''Create second drive''' checked. The predefined value for the drive is automatically entered in the '''Drive number''' field.</translate></li>
<translate><!--T:40--> By using the additional dedicated drive for the restore, you can perform a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration. (For details, see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store#access|Drive access mode]].)</translate>
<li><translate><!--T:41--> The name in '''Create new drive group''' is already created. You can change it by simply entering a new name.</translate></li>
<li><translate><!--T:42--> The predefined number of channels is already available in the '''Max. channels''' drop-down list. The number of available channels depends on your SEP sesam Server package. For details on licensing, see [[Special:MyLanguage/Licensing|Licensing]].</translate></li>
<li><translate><!--T:43--> From the ''Device server'' drop-down list, select the '''device server''' for your data store.</translate></li>
<li><translate><!--T:44-->
In the '''Path''' field, '''enter the location''' or use the '''Browse''' button to select a directory on the local disk (as for local storage). This directory is only used to store metadata and temporary files for intermediate storage until the data is uploaded to S3. Ensure that there is sufficient disk-space available for this local storage, e.g., for 50 TiB in S3 or more, make sure it has 20 GiB free space.
Click '''OK'''.</translate>
<br />
<translate><!--T:45--> If you use the ''Browse'' button, the ''New Data Store'' information window appears with predefined recommended values for the size of your Si3 NG deduplication store, based on the size of the previously selected local disk (Path).</translate>
<br /><translate><!--T:46--> '''''Important'': Change these values manually under the ''Size'' properties, depending on how much storage space you want to use on S3.''' </translate>
<ul><li><translate><!--T:47--> '''Capacity''': Set the size (in GB/GiB) of the storage for backups.</translate></li>
<li><translate><!--T:48--> '''High watermark''': The HWM defines the upper value for the used storage space. When this value is reached, the status of a datastore changes from ''OK'' to ''Warning'', but backups continue to be performed. Make sure that you provide enough storage space for your backed up data.</translate></li></ul>
<translate><!--T:49--> Click '''OK'''. You can also change the size of your Si3 NG deduplication store later under '''Size''' properties (see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store#size|Size properties]]).</translate>
<translate><!--T:50--> {{warning|Since S3 offers unlimited scalability and there is no official limit to the amount of data and number of objects you can store in an S3 bucket, you should set the capacity of Si3 NG on S3 according to your needs. If you know how much capacity you need, you can optimize the cost of your cloud services.}}</translate>
</li>
</li>
<li>Under ''Drive parameter'', leave the options '''Create drive''' and '''Create second drive''' checked. The predefined value for the drive is automatically entered in the '''Drive number''' field.</li>
<translate><!--T:51--> [[image:create_Si3-ng-S3.jpg|800px|link=]]</translate>
By using the additional dedicated drive for the restore, you can perform a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration. (For details, see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store#access|Drive access mode]].)
<li>The name in '''Create new drive group''' is already created. You can change it by simply entering a new name.</li>
<li>The predefined number of channels is already available in the '''Max. channels''' drop-down list. The number of available channels depends on your SEP sesam Server package. For details on licensing, see [[Special:MyLanguage/Licensing|Licensing]].</li>
<li>From the ''Device server'' drop-down list, select the '''device server''' for your data store.</li>
<li>In the '''Path''' field, '''enter the location''' or use the '''Browse''' button to select a directory on the local disk (as for local storage). This directory is only used to store metadata and temporary files for intermediate storage until the data is uploaded to S3.
Click '''OK'''.
<br>
If you use the ''Browse'' button, the ''New Data Store'' information window appears with predefined recommended values for the size of your Si3 NG deduplication store, based on the size of the previously selected local disk (Path).
<br />'''''Important'': Change these values manually under the ''Size'' properties, depending on how much storage space you want to use on S3.'''
<ul><li>'''Capacity''': Set the size (in GB/GiB) of the storage for backups.</li>
<li>'''High watermark''': The HWM defines the upper value for the used storage space. When this value is reached, the status of a datastore changes from ''OK'' to ''Warning'', but backups continue to be performed. Make sure that you provide enough storage space for your backed up data.</li></ul>
Click '''OK'''. You can also change the size of your Si3 NG deduplication store later under '''Size''' properties (see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store#size|Size properties]]).
{{warning|Since S3 offers unlimited scalability and there is no official limit to the amount of data and number of objects you can store in an S3 bucket, you should set the capacity of Si3 NG on S3 according to your needs. If you know how much capacity you need, you can optimise the cost of your cloud services.}}
</li>
[[image:create_Si3-ng-S3.jpg|750px|link=]]
<br clear=all>
<br clear=all>
<li>
<li><translate><!--T:52--> Switch to the ''Storage Backend'' tab and select ''Storage type'': ''Amazon S3 or compatible''. Then click ''New'' to create a new credential set for S3. You will need to enter your previously configured credentials, see section [[Special:MyLanguage/5_0_0:Backup_to_S3_Cloud_Storage#user|Creating a new backup user]] above.</translate></li>
Switch to the ''S3 Credentials'' tab and enter your previously configured credentials, see section [[Special:MyLanguage/Si3_NG_Direct_to_S3#user|Creating a new backup user]] above.</li>
*<translate><!--T:53--> Credential set: give your credential set a name.</translate>
 
*<translate><!--T:54--> Endpoint URL: enter the endpoint URL for your S3 storage account.</translate> 
[[Image:S3-credentials_Si3-ng-S3.jpg|750px|link=]]
* <translate><!--T:55--> In the ''Access key'' field, type the AWS access key ID (for example, AKIAIOSFODNN7EXAMPLE).</translate>
* <translate><!--T:56--> In the ''Secret key'' field, type the AWS secret access key (for example, wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY). </translate>
* <translate><!--T:57--> In the ''Verify secret key'' field, type the AWS secret access key again.</translate>
*<translate><!--T:58-->
In the ''Bucket name'' field, enter the name of your bucket.
[[Image:S3-credentials_Si3-ng-S3.jpg|800px|link=]]</translate>
<br clear=all>
<br clear=all>
<li>
<li><translate>
If you want to create a media pool for your Si3 deduplication store immediately, click '''Create Media Pool'''. Otherwise, click '''OK''' to configure your Si3 deduplication store.</li></ol>
<!--T:59-->
 
If you want to create a media pool for your Si3 deduplication store immediately, click '''Create Media Pool'''. Otherwise, click '''OK''' to configure your Si3 deduplication store.</translate></li></ol>
==={{anchor|data_store}}Configuring media pools for Si3 NG===


<ol><li>From ''Main Selection'' -> '''Media Pools''', click '''New Media Pool'''. The ''New Media Pool'' window is displayed.</li>
==={{anchor|data_store}}<translate><!--T:60--> Configuring media pools for Si3 NG </translate>===
<li>{{anchor|media_pool}}In the ''Media Pool'' window, specify the required fields:</li>


[[Image:Si3-NG_media_pool.jpg|link=]]
<ol><li><translate><!--T:61--> From ''Main Selection'' -> '''Media Pools''', click '''New Media Pool'''. The ''New Media Pool'' window is displayed.</translate></li>
<li>{{anchor|media_pool}}<translate><!--T:62--> In the ''Media Pool'' window, specify the required fields:</translate></li>
<translate><!--T:63--> [[Image:Si3-NG_AWS_media_pool.jpg|500px|link=]]</translate>
<br clear=all>
<br clear=all>
<ul><li>'''''Name''''': Enter a name for a media pool.</li>
<ul><li><translate><!--T:64--> '''''Name''''': Enter a name for a media pool.</translate></li>
<li>'''''Description''''': Optionally, add a description of the pool.</li>
<li><translate><!--T:65--> '''''Description''''': Optionally, add a description of the pool.</translate></li>
<li>'''''Drive group''''':  From the drop-down list of all available drive groups, select the relevant drive group to which a media pool will be attached. For details on drive groups, see [[Special:MyLanguage/4_4_3_Beefalo:Drives#drive_group|Drives]]. </li>
<li><translate><!--T:66--> '''''Drive group''''':  From the drop-down list of all available drive groups, select the relevant drive group to which a media pool will be attached. For details on drive groups, see [[Special:MyLanguage/4_4_3_Beefalo:Drives#drive_group|Drives]].</translate></li>
<li>'''''Retention time [days]''''': Specify the retention time for the media pool. The retention time period starts with the date a saveset is written to the media. The expiry date of the retention time is the EOL of the saveset. After the retention time expires, the saveset is deleted while the purge is running on the data store and the memory space is released. For details, see [[Special:MyLanguage/Managing_EOL|LINK NAME]].</li>  
<li><translate><!--T:67--> '''''Retention time [days]''''': Specify the retention time for the media pool. The retention period begins with the date a saveset is written to the media (at the end time of the first backup) and thus defines the expiry date of the saveset - EOL. When the protection (EOL) expires, SEP sesam can use the media for backups again. For details, see [[Special:MyLanguage/5_0_0:Automatic_Retention_(EOL)_Management#dependency-based_retention|What is retention time and EOL]].</translate></li>  
</li></ol>
</li></ol>


<translate><!--T:68--> You can repeat the procedure and create more media pools for Si3 NG according to your needs.</translate>
<!--
{{tip|
{{tip|
*You can check which media pools are configured with a data store in the data store properties: from ''Main Selection'' -> '''Data Stores''' -> double-click the selected data store -> select the '''Media''' (previously ''Areas'') tab. By clicking the media pool in the list, its properties are displayed.
*You can check which media pools are configured with a data store in the data store properties: from ''Main Selection'' -> '''Data Stores''' -> double-click the selected data store -> select the '''Media''' (previously ''Areas'') tab. By clicking the media pool in the list, its properties are displayed.
*You can also check the Web UI -> Data Stores -> click the ''Dependencies'' tab to see the diagram of all dependencies of the datastore and ''Drives - RDS'' (first tab) or the datastore and ''Media Pools - Drive Groups - Drives - RDS'' (second tab). Hovering the cursor over the diagram shows a tooltip with details for each object.}}
*You can also check the Web UI -> Data Stores -> click the ''Dependencies'' tab to see the diagram of all dependencies of the datastore and ''Drives - RDS'' (first tab) or the datastore and ''Media Pools - Drive Groups - Drives - RDS'' (second tab). Hovering the cursor over the diagram shows a tooltip with details for each object.}}


[[Image:Si3-ng-S3_dependencies.jpg|850px|link=]]
[[Image:Si3-ng-S3_dependencies.jpg|800px|link=]]
<br clear=all>-->
=={{anchor|bck}}<translate><!--T:69--> Configuring backup</translate>==
 
<translate><!--T:70-->
After you have configured an Si3 NG deduplication store and one or more media pools, proceed as follows:</translate>
#<translate><!--T:71--> [[Special:MyLanguage/Creating_a_Backup_Task|Create a backup task]] to back up to S3.</translate>
#<translate><!--T:72-->
Configure a schedule as described in [[Special:MyLanguage/Creating a Schedule|Creating a Schedule]].
 
<!--T:73-->
Once you have configured a task and schedule, create a backup event as follows.</translate>
 
==={{anchor|event}}<translate><!--T:74--> Creating a backup event</translate>===
 
<translate><!--T:75-->
By creating a backup event, you select the [[Special:MyLanguage/SEP_sesam_Glossary#backup_level|backup level]], set event priority, and specify where to back up your data. You can create an event for a specific task or for a task group. The latter enables you to trigger all the tasks in the [[Special:MyLanguage/Adding_a_Task_to_the_Task_Group|task group]] with a single event.</translate>
 
<ol><li><translate>
<!--T:76-->
From '''Main Selection -> Scheduling -> Schedules''', right-click the schedule you created earlier and click '''New Backup Event'''.</translate></li>
<li><translate>
<!--T:77-->
Under the ''Sequence control'', set the '''Priority''' of your backup event. SEPuler always executes the events with the highest priority first. The default priority level is 1, which is the lowest priority (the highest priority is 99). The only exception are schedules with priority 0, which override all other priorities and are always executed.</translate>
<translate><!--T:78--> For details, see [[Special:MyLanguage/4_4_3_Beefalo:SEPuler_-_an_event_calendar#event_priority|Setting Event Priorities]]. You can also enable the '''Blocking date'''. This option should be used together with the high priority for special events. When this option is enabled, events of the same type but with a lower priority are blocked, so that the backup is executed even if other backups are scheduled for the same time.</translate></li>
<li><translate><!--T:79--> Under ''Object'', select the task (or task group) you configured earlier and with which you want to link this event. </translate></li>
<li><translate><!--T:80--> Under ''Parameter'', specify the '''Backup level'''.</translate></li>
<li><translate>
<!--T:81-->
From the '''Media pool''' drop-down list, select the media pool you created for the Si3 NG deduplication store. The data is backed up to this pool. You can also activate the option '''SEP Si3 source-side deduplication'''.</translate><br />
<translate><!--T:82--> [[image:Si3-ng-S3-bck_event.jpg|800px|link=]]</translate>
<br clear=all>
<br clear=all>
*<translate><!--T:83--> Optionally, specify the '''drive number''' of the drive to be used to write the data. Typically, you use this option if you have configured additional drives and want to assign a specific drive exclusively for backup.</translate></li>
<li><translate><!--T:84--> In the '''Follow up''' field, you can configure events (e.g., migration) that are triggered on the SEP sesam Server as soon as the first event (e.g., backup) is completed. For details, see [[Special:MyLanguage/Follow-up_Events|Follow-up events]].</translate></li>
<translate><!--T:85--> {{tip|You can set a follow-up [[Special:MyLanguage/Configuring_Migration|migration task]] by selecting the previously configured migration task from the '''Migration task''' drop-down list.}}</translate></ol>


=={{anchor|bck}}Configuring backup==
=={{anchor|monitor}}<translate><!--T:86--> Monitoring backups</translate>==  


After you have configured an Si3 NG deduplication store and one or more media pools, proceed as follows:
<translate><!--T:87-->
#[[Special:MyLanguage/Creating_a_Backup_Task|Create a backup task]] to back up to S3.
You can view the status of your backup jobs in the GUI (''Monitoring'' -> ''Last Backup State'' or ''Job State'' -> ''Backups'') or [[Special:MyLanguage/SEP_sesam_Web_UI|SEP sesam Web UI]]. The backup status overview provides detailed information about the last run of backup jobs, including the task name, start and stop time of the last backup, backup level, data size, throughput, assigned media pool, etc.</translate>
#Configure a schedule as described in [[Special:MyLanguage/Creating a Schedule|Creating a Schedule]].


Once you have configured a task and schedule, create a backup event as follows.
== {{anchor|purge}}<translate><!--T:88--> Purging data on S3 storage</translate>==


===Creating a Backup Event===
<translate><!--T:89-->
Data purging is the process of permanently deleting obsolete ([[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL-free]]) savesets from regular data stores. It works in the same way in the S3 cloud. The purge is automatically triggered and performed until all [[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL-free]] savesets are deleted.


By creating a backup event, you select the [[Special:MyLanguage/SEP_sesam_Glossary#backup_level|backup level]], set event priority and specify where to back up your data to. You can create an event for a specific task or for a task group. The latter enables you to trigger all the tasks in the [[Special:MyLanguage/Adding_a_Task_to_the_Task_Group|task group]] with a single event.
===== Automatically purging data ===== <!--T:90-->


<ol><li>
<!--T:91-->
From '''Main Selection -> Scheduling -> Schedules''', right-click the schedule you created earlier and click '''New Backup Event'''.</li>
Strategies for data purging are based on the nature of your business, as well as regulatory, legal and other requirements, and implemented with a defined data retention period. This is the period of time for which backup data is protected after it is written to the media, so that the savesets are preserved and available for restore. It is based on the media pool retention time you set when you created a [[Special:MyLanguage/SEP_sesam_Glossary#media_pool|media pool]]. SEP sesam provides automatic EOL (retention) management to ensure recoverability of the entire backup chain and protect against data loss, based on the backup chain dependencies. For more details, see [[Special:MyLanguage/5_0_0:Automatic_Retention_(EOL)_Management#bck_chain|What are backup chain dependencies]].  
<li>
 
Under the ''Sequence control'', set the '''Priority''' of your backup event. SEPuler always executes the schedules with the highest priority first. The default priority level is 1, which is the lowest priority (the highest priority is 99). The only exception are schedules with priority 0, which override all other priorities and are always executed.
<!--T:92-->
For details, see [[Special:MyLanguage/4_4_3_Beefalo:SEPuler_-_an_event_calendar#event_priority|Setting Event Priorities]]. You can also enable the '''Blocking date'''. This option should be used together with the high priority for special events. When this option is enabled, events of the same type but with a lower priority are blocked, so that the backup is executed even if other backups are scheduled for the same time.</li>
When protection ([[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL]]) expires, purging is done automatically and SEP sesam can use the media for backups again. For more details, see [[Special:MyLanguage/5_0_0:Automatic_Retention_(EOL)_Management#expired_EOL|What happens when retention expires]].
<li>Under ''Object'', select the task (or task group) you configured earlier and with which you want to link this event. </li>
 
<li>Under ''Parameter'', specify the '''Backup level'''.</li>
<!--T:93-->
<li>
Events that trigger the data store purge are:
From the '''Media pool''' drop-down list, select the media pool you created for the Si3 NG deduplication store. The data is backed up to this pool. You can also activate the option '''SEP Si3 source-side deduplication'''.<br />
*[[Special:MyLanguage/SEP_sesam_Glossary#NEWDAY|NEWDAY]]
[[image:Si3-ng-S3-bck_event.jpg|750px|link=]]
*Manual start of the purge in the GUI
<br clear=all>
 
*Optionally, specify the '''drive number''' of the drive to be used to write the data. Typically, you use this option if you have configured additional drives and want to assign a specific drive exclusively for backup. </li>
===== Manually purging data ===== <!--T:94-->
<li>In the '''Follow up''' field, you can configure events (e.g., migration) that are triggered on the SEP sesam Server as soon as the first event (e.g., backup) is completed. For details, see [[Special:MyLanguage/Follow-up_Events|Follow-up events]].</li>
{{tip|You can set a follow-up [[Special:MyLanguage/Configuring_Migration|migration task]] by selecting the previously configured migration task from the '''Migration task''' drop-down list.}}</ol>


=={{anchor|monitor}}Monitoring backups==
<!--T:95-->
*You can manually ''adjust the EOL'' of your data or ''delete a saveset or backup''. For details, see [[Special:MyLanguage/Changing_Retention_(EOL)|Changing Retention (EOL)]].
*You can start the data store purge process in the GUI: Main Selection window -> ''Components'' -> ''Data Stores'' content pane -> option ''Purge''. Running the purge manually deletes the obsolete ([[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL-free]]) savesets.


You can view the status of your backup jobs in the GUI (''Monitoring'' -> ''Last Backup State'' or ''Job State'' -> ''Backups'') or [[Special:MyLanguage/SEP_sesam_Web_UI|SEP sesam Web UI]]. The backup status overview provides detailed information about the last run of backup jobs, including the task name, start and stop time of the last backup, backup level, data size, throughput, assigned media pool, etc.
<!--T:96-->
*Another way to free up storage space is to remove orphaned savesets from the data stores by using the ''Clean up'' option: Main Selection window -> ''Components'' -> ''Data Stores'' content pane -> option ''Clean up''. This is useful if a data store seems to be inaccessible, its space is occupied, or SEP sesam space check shows non-sesam data. </translate>


=={{anchor|comparison}}Comparison of Si3 and Si3 NG==
=={{anchor|comparison}}<translate><!--T:97--> Comparison of Si3 and Si3 NG</translate>==  
{{Si3_and_Si3_NG_comparison}}
<translate>
<!--T:106-->
{{Si3_and_Si3_NG_comparison/en}}</translate>
<translate><!--T:98--> {{tip|The '''new immutable storage feature''' (introduced in [[SEP sesam Release Versions|Jaglion V2]]) is also based on Si3 NG store (set up on a dedicated Linux server). ''SiS'' is SEP Immutable Storage, based on the File Protection Service (FPS), which scans the file system and sets the immutable bit for all new objects. This means that all data stored in SiS is marked immutable at the time of storage. Even with full admin access to the SEP sesam backup server, attackers cannot delete, modify, or encrypt data stored on ''SiS''. For details, see [[Special:MyLanguage/5_0_0:SEP_Immutable_Storage_–_SiS|SEP Immutable Storage – SiS]].}}</translate>


<noinclude>
<noinclude><div class="noprint">
<div class="noprint">
<translate><!--T:99-->
== See also==
== See also==
[[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/Deduplication|Deduplication]] – [[Special:MyLanguage/Source_Side_Dedup|Configuring Source-side Deduplication]] – [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] – [[Special:MyLanguage/Licensing|Licensing]]</div><noinclude>
[[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/Encrypting_Si3_NG_Deduplication_Store|Encrypting Si3 NG Deduplication Store]] – [[Special:MyLanguage/Standard Backup Procedure|Standard Backup Procedure]] – [[Special:MyLanguage/5_0_0:Restore_Assistant|Restore Assistant]] – [[Special:MyLanguage/Standard Restore Procedure|Standard Restore Procedure]] – [[Special:MyLanguage/Licensing|Licensing]]</translate></div><noinclude>

Revision as of 09:48, 17 May 2023

Other languages:

Template:Copyright SEP AG en

Draft.png WORK IN PROGRESS
This article is in the initial stage and may be updated, replaced or deleted at any time. It is inappropriate to use this document as reference material as it is a work in progress and should be treated as such.


Docs latest icon.png Welcome to the latest SEP sesam documentation version 5.0.0 Jaglion. For previous documentation version(s), check documentation archive.


Overview

SEP sesam v. 5.0.0 Jaglion has introduced a new generation Si3 data store: Si3 NG. It enables you to back up your data directly to the S3 (Simple Storage Solution) cloud storage and restore the items you want directly from there. After an initial full backup of your virtual and physical environment, you can use any backup level (including differential and incremental backups) to back up only new data to the cloud.

Si3 NG offers significantly improved performance for backup, restore and migration, resulting in improved performance, scaling and resource savings. For a comparison of the two deduplication stores, see the section Comparison of Si3 and Si3 NG below.

Powerful restore

The new Si3 NG can detect duplicate data fragments to streamline the restore process. Use the Web Restore Assistant or GUI Restore Wizard to instantly restore your data from backups. Restoring a single file is easy as you can use the search function to find the desired backup and start the restore process to the to the original or another location.

Si3 NG uses S3 in the same way as local storage, allowing you to use your S3 cloud storage to securely store and retrieve your business data anytime, anywhere.

Multiple media pools

Si3 NG lets you create multiple media pools to provide scalability and granularity of backup jobs. You can create separate media pools, e.g., for daily differential and incremental and weekly full backup jobs, or for migration and replication, and you can set a different retention time for each media pool.

SEP sesam support for S3-compatible cloud and blob storage

With Si3 NG, you can back up your data directly to the S3 cloud and (from Jaglion V2) to Microsoft Azure. As S3 is an open API standard and AWS Simple Storage Service is a sample implementation of the standard, SEP sesam Si3 NG can also be used with other S3-compatible cloud implementations. The configuration and management of Si3 NG in an S3-compatible cloud implementation is similar to the example shown in this article and must follow the same process and rules provided for using Si3 NG with S3.
Note, however, that some S3-compatible cloud environments have not yet been validated by SEP and may not work in some cases. You are solely responsible for the use of SEP sesam in a non-S3 compatible cloud environment and agree that SEP shall not be responsible for it. For the list of supported object storage, see the support matrix.

Updating Si3 NG on S3 from 5.0.0.4 to the new version

If you use Si3 NG on S3 and update from 5.0.0.4 to the new version, the structure of the existing stores will change as the structure of Si3 NG on S3 is automatically recreated (this includes recreating the index after the renaming). Example:

  • The S3 bucket is called seps3, the Si3 NG deduplication store name is newNG. The S3 structure with version 5.0.0.4 of NG is: seps3/pages; seps3/pages-trash; seps3/objects-trash.
  • When updating to the next version of NG, the structure changes to: seps3/newNG/pages; seps3/newNG/pages-trash; seps3/newNG/objects-trash. During this renaming, the Si3 NG service is not available.

Configuration of Si3 NG S3 store

SEP sesam enables you to back up your data directly to S3 cloud storage using Si3 NG deduplication store. This procedure contains only the basic steps. For details on Amazon S3 storage configuration, see the Amazon Simple Storage Service Documentation.

  1. Create a bucket
  2. Create a new backup user
  3. Configure the Si3 NG deduplication store
  4. Configure media pools
  5. Configure backups

Create a bucket

Sign-up for S3 and create a bucket (container) where every object in S3 is stored. The term bucket is used to describe the container for backup data.

  1. Sign in to the AWS Management Console and open the Amazon S3 console at https://console.aws.amazon.com/s3/
  2. Select Create bucket and enter all required information. Follow the Amazon Simple Storage Service instructions: Creating a Bucket.

Create a new backup user

On S3, configure an AWS identity and IAM (Access Management user <user_name> with administrative user rights. Sign in to the IAM console as the account owner by selecting Root user and providing your AWS account email address.
Follow the recommendation and use your root user credentials only to create your IAM admin user. For details, see the AWS Identity and Access Management documentation: Creating an Administrator IAM User and Group.

Information sign.png Note
AWS access keys consist of an access key ID and a secret access key. Both keys are required to authenticate access. These credentials are also required to create an Si3 NG data store for S3.

The S3 credentials are stored encrypted (not in plain text) in the ini file.

Configure the Si3 NG deduplication store

  1. In the Main selection -> Components, click Data Stores to display the data store contents frame.
  2. From the Data Stores menu, select New Data Store. A New Data Store dialog appears.
  3. Under Data store properties, enter a meaningful name for the Si3 NG deduplication store in the Name field, e.g., Si3-NG-S3. Entering the name also creates the name of the drive group for your Si3 deduplication store in the Create new drive group field.
  4. From the Store type drop-down list, select SEP Si3 NG Deduplication Store.
  5. Under Drive parameter, leave the options Create drive and Create second drive checked. The predefined value for the drive is automatically entered in the Drive number field.
  6. By using the additional dedicated drive for the restore, you can perform a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration. (For details, see Drive access mode.)
  7. The name in Create new drive group is already created. You can change it by simply entering a new name.
  8. The predefined number of channels is already available in the Max. channels drop-down list. The number of available channels depends on your SEP sesam Server package. For details on licensing, see Licensing.
  9. From the Device server drop-down list, select the device server for your data store.
  10. In the Path field, enter the location or use the Browse button to select a directory on the local disk (as for local storage). This directory is only used to store metadata and temporary files for intermediate storage until the data is uploaded to S3. Ensure that there is sufficient disk-space available for this local storage, e.g., for 50 TiB in S3 or more, make sure it has 20 GiB free space. Click OK.
    If you use the Browse button, the New Data Store information window appears with predefined recommended values for the size of your Si3 NG deduplication store, based on the size of the previously selected local disk (Path).
    Important: Change these values manually under the Size properties, depending on how much storage space you want to use on S3.
    • Capacity: Set the size (in GB/GiB) of the storage for backups.
    • High watermark: The HWM defines the upper value for the used storage space. When this value is reached, the status of a datastore changes from OK to Warning, but backups continue to be performed. Make sure that you provide enough storage space for your backed up data.

    Click OK. You can also change the size of your Si3 NG deduplication store later under Size properties (see Size properties).

    SEP Warning.png Warning
    Since S3 offers unlimited scalability and there is no official limit to the amount of data and number of objects you can store in an S3 bucket, you should set the capacity of Si3 NG on S3 according to your needs. If you know how much capacity you need, you can optimize the cost of your cloud services.
  11. Create Si3-ng-S3.jpg
  12. Switch to the Storage Backend tab and select Storage type: Amazon S3 or compatible. Then click New to create a new credential set for S3. You will need to enter your previously configured credentials, see section Creating a new backup user above.
    • Credential set: give your credential set a name.
    • Endpoint URL: enter the endpoint URL for your S3 storage account.
    • In the Access key field, type the AWS access key ID (for example, AKIAIOSFODNN7EXAMPLE).
    • In the Secret key field, type the AWS secret access key (for example, wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY).
    • In the Verify secret key field, type the AWS secret access key again.
    • In the Bucket name field, enter the name of your bucket.
    S3-credentials Si3-ng-S3.jpg
  13. If you want to create a media pool for your Si3 deduplication store immediately, click Create Media Pool. Otherwise, click OK to configure your Si3 deduplication store.

Configuring media pools for Si3 NG

  1. From Main Selection -> Media Pools, click New Media Pool. The New Media Pool window is displayed.
  2. In the Media Pool window, specify the required fields:
  3. Si3-NG AWS media pool.jpg
    • Name: Enter a name for a media pool.
    • Description: Optionally, add a description of the pool.
    • Drive group: From the drop-down list of all available drive groups, select the relevant drive group to which a media pool will be attached. For details on drive groups, see Drives.
    • Retention time [days]: Specify the retention time for the media pool. The retention period begins with the date a saveset is written to the media (at the end time of the first backup) and thus defines the expiry date of the saveset - EOL. When the protection (EOL) expires, SEP sesam can use the media for backups again. For details, see What is retention time and EOL.

You can repeat the procedure and create more media pools for Si3 NG according to your needs.

Configuring backup

After you have configured an Si3 NG deduplication store and one or more media pools, proceed as follows:

  1. Create a backup task to back up to S3.
  2. Configure a schedule as described in Creating a Schedule.

Once you have configured a task and schedule, create a backup event as follows.

Creating a backup event

By creating a backup event, you select the backup level, set event priority, and specify where to back up your data. You can create an event for a specific task or for a task group. The latter enables you to trigger all the tasks in the task group with a single event.

  1. From Main Selection -> Scheduling -> Schedules, right-click the schedule you created earlier and click New Backup Event.
  2. Under the Sequence control, set the Priority of your backup event. SEPuler always executes the events with the highest priority first. The default priority level is 1, which is the lowest priority (the highest priority is 99). The only exception are schedules with priority 0, which override all other priorities and are always executed. For details, see Setting Event Priorities. You can also enable the Blocking date. This option should be used together with the high priority for special events. When this option is enabled, events of the same type but with a lower priority are blocked, so that the backup is executed even if other backups are scheduled for the same time.
  3. Under Object, select the task (or task group) you configured earlier and with which you want to link this event.
  4. Under Parameter, specify the Backup level.
  5. From the Media pool drop-down list, select the media pool you created for the Si3 NG deduplication store. The data is backed up to this pool. You can also activate the option SEP Si3 source-side deduplication.
    Si3-ng-S3-bck event.jpg
    • Optionally, specify the drive number of the drive to be used to write the data. Typically, you use this option if you have configured additional drives and want to assign a specific drive exclusively for backup.
  6. In the Follow up field, you can configure events (e.g., migration) that are triggered on the SEP sesam Server as soon as the first event (e.g., backup) is completed. For details, see Follow-up events.
  7. SEP Tip.png Tip
    You can set a follow-up migration task by selecting the previously configured migration task from the Migration task drop-down list.

Monitoring backups

You can view the status of your backup jobs in the GUI (Monitoring -> Last Backup State or Job State -> Backups) or SEP sesam Web UI. The backup status overview provides detailed information about the last run of backup jobs, including the task name, start and stop time of the last backup, backup level, data size, throughput, assigned media pool, etc.

Purging data on S3 storage

Data purging is the process of permanently deleting obsolete (EOL-free) savesets from regular data stores. It works in the same way in the S3 cloud. The purge is automatically triggered and performed until all EOL-free savesets are deleted.

Automatically purging data

Strategies for data purging are based on the nature of your business, as well as regulatory, legal and other requirements, and implemented with a defined data retention period. This is the period of time for which backup data is protected after it is written to the media, so that the savesets are preserved and available for restore. It is based on the media pool retention time you set when you created a media pool. SEP sesam provides automatic EOL (retention) management to ensure recoverability of the entire backup chain and protect against data loss, based on the backup chain dependencies. For more details, see What are backup chain dependencies.

When protection (EOL) expires, purging is done automatically and SEP sesam can use the media for backups again. For more details, see What happens when retention expires.

Events that trigger the data store purge are:

  • NEWDAY
  • Manual start of the purge in the GUI
Manually purging data
  • You can manually adjust the EOL of your data or delete a saveset or backup. For details, see Changing Retention (EOL).
  • You can start the data store purge process in the GUI: Main Selection window -> Components -> Data Stores content pane -> option Purge. Running the purge manually deletes the obsolete (EOL-free) savesets.
  • Another way to free up storage space is to remove orphaned savesets from the data stores by using the Clean up option: Main Selection window -> Components -> Data Stores content pane -> option Clean up. This is useful if a data store seems to be inaccessible, its space is occupied, or SEP sesam space check shows non-sesam data.

Comparison of Si3 and Si3 NG

SEP sesam v. 5.0.0 Jaglion has introduced a new generation Si3 deduplication store. Si3 offers significantly higher performance for backup, restore and migration, as well as backup to S3 cloud and backup to Azure, the new immutable storage feature SiS, resulting in improved performance, scaling, and resource savings.

Function Si3 Si3 NG
Si3 backup YesY YesY
Si3 deduplication (source-side and target-side) YesY YesY
Si3 replication: local to remote store Notea YesY Si3 V1 to Si3 V1 YesY Si3 V1 to Si3; Si3 to Si3
Si3 replication: to S3 cloud YesY NoN (provides more powerful features for backing up directly to the cloud, see the next two lines)
Backup to S3 Cloud Storage NoN YesY
Backup to Azure Storage NoN YesY (as of Jaglion V2)
SiS (SEP Immutable Storage) NoN YesY (as of Jaglion V2)
Si3 restore YesY YesY
Si3 encryption YesY YesY (as of Jaglion V2)
Seeding Si3 deduplication store Noteb YesY NoN
Usage of tachometer YesY NoN
Notea

SEP sesam does not support a direct upgrade from the Si3 V1 to new Si3. However, to use the new Si3 you can:

  • Back up all data again to the newly configured Si3 deduplication store.
  • After configuring a new Si3, you can also create a replication job to replicate from the Si3 V1 to the Si3 store. Replication reads all the data from the source-side store on the source-side RDS and sends it to the target store using the source-side deduplication function. For details, see Replicating from Si3 V1 to Si3.
  • You can also configure a new Si3 and an old Si3 V1 in parallel on the same host by enabling the key enable_gui_allow_multi_dedup.
Noteb

The Initial Seed feature does not work in v. 5.0.0 Jaglion, but you can use it in earlier SEP sesam versions.


SEP Tip.png Tip
The new immutable storage feature (introduced in Jaglion V2) is also based on Si3 NG store (set up on a dedicated Linux server). SiS is SEP Immutable Storage, based on the File Protection Service (FPS), which scans the file system and sets the immutable bit for all new objects. This means that all data stored in SiS is marked immutable at the time of storage. Even with full admin access to the SEP sesam backup server, attackers cannot delete, modify, or encrypt data stored on SiS. For details, see SEP Immutable Storage – SiS.