View source for 5 0 0:Backup to Azure Storage

<noinclude><translate><!--T:1-->
<div class="noprint"><languages />
{{Copyright SEP AG en}}
{{draft}}

<!--T:2-->
{{Navigation_latest|release=[[SEP_sesam_Release_Versions|5.0.0 ''Jaglion V2'']]|link=[[Special:MyLanguage/Si3_Deduplication|documentation archive]]}}</div></translate><br />
<translate>==Overview== <!--T:3--></translate>
<div class="boilerplate metadata" id="Additional resources" style="background-color: #f0f0f0; color:#636f73; border: 1px ridge #cdd3db; margin: 0.5em; padding: 0.5em; float: right; width: 35%; "><center><b>
<translate><!--T:4--> Additional resources</translate></b></center>

{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_next.png|45px|link=http://www.sep.de/products/deduplication/deduplication-analysis/#_]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" | 
<translate><!--T:5--> See also: [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/Encrypting_Si3_NG_Deduplication_Store|Encrypting Si3 NG Deduplication Store]] – [[Special:MyLanguage/Standard Backup Procedure|Standard Backup Procedure]] – [[Special:MyLanguage/5_0_0:Restore_Assistant|Restore Assistant]] – [[Special:MyLanguage/Standard Restore Procedure|Standard Restore Procedure]] – [[Special:MyLanguage/Licensing|Licensing]]</translate>
|}

{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP_Video.png|45px|link=Video Tutorials & Screencasts]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |<translate><!--T:6--> Watch SEP sesam video [https://www.youtube.com/watch?v=sSkfmufQkXU Why and how to use Deduplication with SEP sesam].</translate>
|}

{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | 
[[File:SEP Tip.png|45px|link=Special:MyLanguage/4_4_3_Beefalo:FAQ|FAQ]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" | 
<translate><!--T:7--> Check [[Special:MyLanguage/FAQ|FAQ]] to find the answers to most common questions.</translate> 
|}

{|style="margin: auto; margin-bottom:1em; width:100%; border:0px solid grey;"
| rowspan="2" style="padding:0px 10px 0px;" | [[File:SEP Troubleshooting.png|45px|link=Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication]]
| style="padding:0px 40px 0px 10px; color: grey; font-size: 90%; text-align:left;" |
<translate><!--T:8--> Problems? Check the [[Special:MyLanguage/Troubleshooting_Guide#Si3_Deduplication|Troubleshooting Guide]].</translate>
|}</div></noinclude>

<translate><!--T:9-->
SEP sesam v. [[SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']] has introduced a new generation Si3 data store: Si3 NG. It enables you to back up your data directly to Azure Blob storage and restore the items you want directly from there. After an initial full backup of your virtual and physical environment, you can use any [[Special:MyLanguage/SEP_sesam_Glossary#backup_level|backup level]] (including differential and incremental backups) to back up only new data to Blob storage.

==== Powerful restore ==== <!--T:10-->

<!--T:11-->
The new Si3 NG can detect duplicate data fragments to streamline the restore process. Use the [[Special:MyLanguage/Restore_Assistant|Web Restore Assistant]] or [[Special:MyLanguage/Standard_Restore_Procedure|GUI Restore Wizard]] to instantly restore your data from backups. Restoring a single file is easy as you can use the search function to find the desired backup and start the restore process to the original or another location. 

<!--T:12-->
Si3 NG uses Azure Blob storage in the same way as local storage, allowing you to use your Azure Blob storage to securely store and retrieve your business data anytime, anywhere.

==== Multiple media pools ==== <!--T:13-->

<!--T:14-->
Si3 NG lets you create multiple [[Special:MyLanguage/Configuring_a_Media_Pool|media pools]] to provide scalability and granularity of backup jobs. You can create separate media pools, e.g., for daily differential and incremental and weekly full backup jobs, or for migration and replication, and you can set a different retention time for each media pool.</translate>

=={{anchor|configuration}}<translate><!--T:15-->
Configuration of Si3 NG Azure Blob store== 

<!--T:16-->
SEP sesam enables you to back up your data directly to Azure using ''Si3 NG deduplication store''. This procedure contains only the basic steps. For details on Azure Blob storage, the account and configuration, see the Microsoft article [https://docs.microsoft.com/en-us/azure/storage/common/storage-account-overview Storage account overview].</translate>

# <translate><!--T:17--> [[#account|Create a Microsoft Azure storage account]]</translate>
# <translate><!--T:18--> [[#container|Create a container]]</translate>
# <translate><!--T:19--> [[#key|View and copy Azure storage account access keys]]</translate>
# <translate><!--T:20--> [[#user|Create a new backup user on the SEP sesam Server]]</translate>
# <translate><!--T:21--> [[#Si3-NG|Configure Si3 NG deduplication store]]</translate> 
# <translate><!--T:22--> [[#media_pool|Configure media pools]]</translate> 
# <translate><!--T:23--> [[#bck|Configure backups]]</translate>

=== {{anchor|account}}<translate><!--T:24-->
Create a Microsoft Azure storage account=== 

<!--T:25-->
You will need an active Microsoft Azure account for the following procedure. Log in to your account in the Azure portal.</translate>
<ol><li><translate><!--T:26--> Search for and click the ''Storage accounts'' option.</translate></li>
<li><translate><!--T:27--> Select ''Create'' to add an account.</translate> 
<ul><li><translate><!--T:28--> Select the subscription for this account.</translate></li>
<li><translate><!--T:29--> Create or select an existing ''Resource Group'' where you want to create this storage account. The resource group is used to organize and manage all your resources.</translate></li>
<li><translate><!--T:30--> Enter a unique name for your new storage account.</translate></li>
<li><translate><!--T:31--> Select a location for the storage account. This is the location for your server based on your geographical location.</translate></li>
<li><translate><!--T:32--> Leave the ''Performance'' type default option ''Standard'' selected.</translate></li>
<li><translate><!--T:33--> For ''Account kind'' select ''StorageV2 (general-purpose v2)'' or ''BlobStorage'', depending on your needs.</translate></li>
<li><translate><!--T:34--> Select the replication level. The default ''Locally Redundant Storage (LRS)'' is more affordable than ''Geo-redundant storage (GRS)'', which is appropriate for storing business-critical data that has to be accessible at all times. This choice can significantly increase the overall cost of your account.</translate></li>
<li><translate><!--T:35--> Select the ''Access tier'' for SEP sesam backup. It is recommended to leave the default setting ''Hot''.</translate></li></ul></li> 
<li><translate><!--T:36--> Use the ''Advanced'' tab to configure or modify additional options for your account, the ''Networking'' tab to configure network connectivity and routing settings, and the ''Data protection'' tab to configure data protection options for blob data in your storage account. Also available are the ''Encryption'' and ''Tags'' tab. Most of these options can be configured later once the storage account has been created.</translate></li>
<li><translate><!--T:37--> Now navigate to the ''Review + Create'' tab to review the settings. When satisfied, click ''Create''.</translate></li></ol>

<translate><!--T:38-->
For a more detailed overview of each step, see the Microsoft article [https://docs.microsoft.com/en-us/azure/storage/common/storage-account-create?tabs=azure-portal Create a storage account].</translate>

=== {{anchor|container}}<translate><!--T:39-->
Create a container=== 

<!--T:40-->
In the Azure portal, create or associate a container with your storage account. For details, see the Microsoft article [https://docs.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-portal Create a container].</translate>
*<translate><!--T:41--> Follow the naming convention and choose a meaningful name for the container.</translate>
*<translate><!--T:42--> Choose the level of public access to the container. It is recommended to leave the default level ''Private'' (no anonymous access).</translate>
*<translate><!--T:43-->
Create containers to be used exclusively with SEP sesam. It is not recommended to use one container for multiple cloud storage devices.</translate>

=== {{anchor|key}}<translate><!--T:44-->
View and copy Azure storage account access keys === 

<!--T:45-->
Azure automatically generates two storage account access keys (''primary'' and ''secondary'') for the account you create. These keys are used to authorize access to data. These login account details are required for creating an Si3 NG data store for Azure.</translate>

#<translate><!--T:46--> In the Azure portal, navigate to the ''Access keys'' item under ''Settings''.</translate>
#<translate><!--T:47-->
Copy the ''Storage account name'' and one of the two access keys. You will need these along with the container name in the next step.</translate>

=== {{anchor|user}}<translate><!--T:48--> Create a new backup user on the SEP sesam Server</translate> === 

<ol><li><translate><!--T:49--> Create the user with the Azure storage account name and credentials on the backup server.</translate></li>
<li><translate><!--T:50--> Log in as an ''Administrator'' with the user type ''superuser'' and add the newly created user to the ''Administrators'' group. For details, see [[Special:MyLanguage/Configuring_Database-Based_Authentication|Configuring Database-Based Authentication]].</translate></li></ol>

{{Note|<translate><!--T:51--> The Azure credentials are stored encrypted in the ''ini'' file.</translate>}}

==={{anchor|Si3-NG}}<translate><!--T:52--> Configure the Si3 NG deduplication store</translate>=== 

<ol><li><translate><!--T:53--> In the '''Main selection''' -> '''Components''', click '''Data Stores''' to display the data store contents frame.</translate></li>
<li><translate><!--T:54-->
From the ''Data Stores'' menu, select '''New Data Store'''. A ''New Data Store'' dialog appears.</li>
<li>Under ''Data store'' properties, enter a meaningful name for the Si3 NG deduplication store in the '''Name''' field, e.g., Si3-NG_Azure. Entering the name also creates the name of the drive group for your Si3 deduplication store in the '''Create new drive group''' field.</translate></li>
<li><translate><!--T:55--> From the ''Store type'' drop-down list, select '''SEP Si3 NG Deduplication Store'''.</translate>
</li>
<li><translate><!--T:56--> Under ''Drive parameter'', leave the options '''Create drive''' and '''Create second drive''' checked. The predefined value for the drive is automatically entered in the '''Drive number''' field.</translate></li>
<translate><!--T:57--> By using the additional dedicated drive for restore, you can perform a backup on the first drive and restore your data from the second drive simultaneously. You can also add a third drive for migration. (For details, see [[Special:MyLanguage/Configuring_Si3_NG_Deduplication_Store#access|Drive access mode]].)</translate>
<li><translate><!--T:58--> The name in '''Create new drive group''' is already created. You can change it by simply entering a new name.</translate></li>
<li><translate><!--T:59--> The predefined number of channels is already available in the '''Max. channels''' drop-down list. The number of available channels depends on your SEP sesam Server package. For details on licensing, see [[Special:MyLanguage/Licensing|Licensing]].</translate></li>
<li><translate><!--T:60--> From the ''Device server'' drop-down list, select the '''device server''' for your data store.</translate></li>
<li><translate><!--T:61-->
In the '''Path''' field, '''enter the location''' or use the '''Browse''' button to select a directory on the local disk (as for local storage). This directory is only used to store metadata and temporary files for intermediate storage until the data is uploaded to Azure Blob storage. Ensure that there is sufficient disk-space available for this local storage, e.g., for 50 TiB in Azure or more, make sure it has 20 GiB free space. 
Click '''OK'''.</translate>
<br /><translate><!--T:62--> If you use the ''Browse'' button, the ''New Data Store'' information window appears with predefined recommended values for the size of your Si3 NG deduplication store, based on the size of the previously selected local disk (Path).</translate>
<br /><translate><!--T:63--> '''''Important'': Change these values manually under the ''Size'' properties, depending on how much storage space you want to use on Azure.''' </translate>
<ul><li><translate><!--T:64--> '''Capacity''': Set the size (in GiB) of storage for backups. The minimum accepted capacity is 5 GiB.</translate></li>
<li><translate><!--T:65--> '''High watermark''': The HWM defines the upper value for the used storage space. When this value is reached, the status of a datastore changes from ''OK'' to ''Warning'', but backups are still performed. Make sure that you provide enough storage space for your backed up data.</translate></li></ul>
<translate><!--T:66--> Click '''OK'''. You can also change the size of your Si3 NG deduplication store later under '''Size''' properties (see [[Special:MyLanguage/Configuring_Si3_NG_Deduplication_Store#size|Size properties]]).</translate>
{{warning|<translate><!--T:67--> Since Azure Blob storage offers unlimited scalability and there is no official limit on the amount of data and number of objects you can store, you should set the capacity of Si3 NG on Azure according to your needs. Knowing how much capacity you need will help you optimize the cost of your cloud services.</translate>}}
</li>
<translate><!--T:68--> [[image:Si3-ng-azure-new-DS.jpg|800px|link=]]</translate>
<br clear=all>
<li>
<translate><!--T:69--> Switch to the ''Storage Backend'' tab and select ''Storage type'': ''Microsoft Azure Storage or compatible''. Then click ''New'' to create a new credential set for Azure. You will need to enter your previously configured credentials, see section [[#key|View and copy Azure storage account access keys]] above.</translate></li>
*<translate><!--T:70--> Storage domain: enter the name of your Blob storage for your storage account; the default endpoint is <nowiki>https://<mystorageaccount>.blob.core.windows.net</nowiki>. If you have mapped a custom domain to the blob endpoint, enter your custom domain.</translate>
**<translate><!--T:71--> If you check the ''Use HTTP'' checkbox, HTTP will be allowed to be used. This can be useful if there are problems with the SSL/TLS certificate and HTTPS does not work. However, it is not recommended to use this option if you are working with confidential data.</translate>
*<translate><!--T:72--> Credential set: give your credential set a name.</translate>   
* <translate><!--T:73--> In the ''Account name'' field, type the Microsoft Azure storage account name.</translate>
* <translate><!--T:74--> In the ''Access key'' field, type the Microsoft Azure storage account access key. You can enter either the primary or secondary access key.</translate> 
* <translate><!--T:75--> In the ''Verify access key'' field, type the Microsoft Azure storage account access key again.</translate>
*<translate><!--T:76-->
In the ''Blob container'' field, enter the name of your blob container.
[[Image:Si3-ng-azure_storage_backend-DS.jpg|800px|link=]]</translate>
<br clear=all>
<li>
<translate><!--T:77--> If you want to create a media pool for your Si3 deduplication store immediately, click '''Create Media Pool'''. Otherwise, click '''OK''' to configure your Si3 deduplication store.</translate></li></ol>

==={{anchor|data_store}}<translate><!--T:78--> Configuring media pools for Si3 NG</translate>===

<ol><li><translate><!--T:79--> From ''Main Selection'' -> '''Media Pools''', click '''New Media Pool'''. The ''New Media Pool'' window is displayed.</translate></li>
<li>{{anchor|media_pool}}<translate><!--T:80--> In the ''Media Pool'' window, specify the required fields:</translate></li>

<translate><!--T:81--> [[Image:Si3-NG-media_pool-Azure.jpg.jpg|500px|link=]]</translate>
<br clear=all>
<ul><li><translate><!--T:82--> '''''Name''''': Enter a name for a media pool.</translate></li>
<li><translate><!--T:83--> '''''Description''''': Optionally, add a description of the pool.</translate></li>
<li><translate><!--T:84--> '''''Drive group''''':  From the drop-down list of all available drive groups, select the relevant drive group to which a media pool will be attached. For details on drive groups, see [[Special:MyLanguage/4_4_3_Beefalo:Drives#drive_group|Drives]].</translate></li>
<li><translate><!--T:85--> '''''Retention time [days]''''': Specify the retention time for the media pool. The retention period begins with the date a saveset is written to the media (at the end time of the first backup) and thus defines the expiry date of the saveset - EOL. When the protection (EOL) expires, SEP sesam can use the media for backups again. For details, see [[Special:MyLanguage/Automatic_Retention_(EOL)_Management#dependency-based_retention|What is retention time and EOL]].</translate></li> 
</li></ol>
<translate><!--T:86-->
You can repeat the procedure and create more media pools for Si3 NG according to your needs.</translate>

=={{anchor|bck}}<translate><!--T:87-->
Configure backup== 

<!--T:88-->
After configuring an Si3 NG Azure deduplication store and one or more media pools, proceed as follows:</translate>
#<translate><!--T:89--> [[Special:MyLanguage/Creating_a_Backup_Task|Create a backup task]] to back up to Azure.</translate>
#<translate><!--T:90--> Configure a schedule as described in [[Special:MyLanguage/Creating a Schedule|Creating a Schedule]].</translate>
<translate><!--T:91-->
Once you have configured a task and schedule, create a backup event as follows.</translate>

==={{anchor|event}}<translate><!--T:92-->
Create a backup event=== 

<!--T:93-->
By creating a backup event, you select the [[Special:MyLanguage/SEP_sesam_Glossary#backup_level|backup level]], set the event priority, and specify where to back up your data. You can create an event for a specific task or for a task group. The latter enables you to trigger all tasks in the [[Special:MyLanguage/Adding_a_Task_to_the_Task_Group|task group]] with a single event.</translate>

<ol><li><translate>
<!--T:94-->
From '''Main Selection -> Scheduling -> Schedules''', right-click the schedule you created earlier and click '''New Backup Event'''.</translate></li>
<li><translate>
<!--T:95-->
Under the ''Sequence control'', set the '''Priority''' of your backup event. SEPuler always executes the schedules with the highest priority first. The default priority level is 1, which is the lowest priority (the highest priority is 99). The only exception are schedules with priority 0, which override all other priorities and are always executed.</translate>
<translate><!--T:96--> For details, see [[Special:MyLanguage/SEPuler_-_an_event_calendar#event_priority|Setting Event Priorities]]. You can also enable the '''Blocking date'''. This option should be used together with ''high priority'' for special events. When this option is enabled, events of the same type but with a lower priority are blocked. For details, see [[Special:MyLanguage/SEPuler_-_an_event_calendar#blocking_events|Blocking Events]].</translate></li>
<li><translate><!--T:97--> Under ''Object'', select the task (or task group) you configured earlier and with which you want to link this event.</translate></li>
<li><translate><!--T:98--> Under ''Parameter'', specify the '''Backup level'''.</translate></li>
<li><translate>
<!--T:99-->
From the '''Media pool''' drop-down list, select the media pool you created for the Si3 NG deduplication store. The data is backed up to this pool. You can also activate the option '''SEP Si3 source-side deduplication''', as described in [[Special:MyLanguage/Source_Side_Dedup|Si3 source deduplication]].</translate><!--<br />
[[image:Si3-ng-azure-bck_event.jpg|800px|link=]]
<br clear=all>-->
*<translate><!--T:100--> Optionally, specify the '''drive number''' of the drive to be used to write the data. Typically, you use this option if you have configured additional drives and want to assign a specific drive exclusively for backup.</translate></li>
<li><translate><!--T:101--> In the '''Follow up''' field, you can configure events (e.g., migration) that are triggered on the SEP sesam Server as soon as the first event (e.g., backup) is completed. For details, see [[Special:MyLanguage/Follow-up_Events|Follow-up events]].</translate></li>
{{tip|<translate><!--T:102--> You can set a follow-up [[Special:MyLanguage/Configuring_Migration|migration task]] by selecting the previously configured migration task from the '''Migration task''' drop-down list.</translate>}}</ol>

=={{anchor|monitor}}<translate><!--T:103-->
Monitoring backups== 

<!--T:104-->
You can view the status of your backup jobs in the GUI (''Monitoring'' -> ''Last Backup State'' or ''Job State'' -> ''Backups'') or [[Special:MyLanguage/SEP_sesam_Web_UI|SEP sesam Web UI]]. The backup status overview provides detailed information about the last run of backup jobs, including the task name, start and stop time of the last backup, backup level, data size, throughput, assigned media pool, etc.</translate>

== {{anchor|purge}}<translate><!--T:105-->
Purging data on Azure storage== 

<!--T:106-->
Data purging is the process of permanently deleting obsolete ([[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL-free]]) savesets from data stores. It works in the same way in the Azure cloud. Purge is automatically triggered and performed until all [[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL-free]] savesets are deleted. 

===== Automatically purging data ===== <!--T:107-->

<!--T:108-->
Strategies for data purging are based on the nature of your business, as well as regulatory, legal and other requirements, and implemented with a defined data retention period. This is the period of time for which backup data is protected after it is written to the media, so that savesets are preserved and available for restore. It is based on the media pool retention time you set when you created a [[Special:MyLanguage/SEP_sesam_Glossary#media_pool|media pool]]. SEP sesam provides automatic EOL (retention) management to ensure recoverability of the entire backup chain and protect against data loss, based on backup chain dependencies. For more details, see [[Special:MyLanguage/Automatic_Retention_(EOL)_Management#bck_chain|What are backup chain dependencies]]. 

<!--T:109-->
When protection ([[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL]]) expires, purging is done automatically and SEP sesam can use the media for backups again. For more details, see [[Special:MyLanguage/Automatic_Retention_(EOL)_Management#expired_EOL|What happens when retention expires]].

<!--T:110-->
Events that trigger the data store purge are:
*[[Special:MyLanguage/SEP_sesam_Glossary#NEWDAY|NEWDAY]]
*Manual start of the purge in the GUI

===== Manually purging data ===== <!--T:111--></translate>

*<translate><!--T:112--> You can manually ''adjust the EOL'' of your data or ''delete a saveset or backup''. For details, see [[Special:MyLanguage/Changing_Retention_(EOL)|Changing Retention (EOL)]].</translate>
*<translate><!--T:113--> You can start the data store purge process in the GUI: Main Selection window -> ''Components'' -> ''Data Stores'' content pane -> option ''Purge''. Running the purge manually deletes the obsolete ([[Special:MyLanguage/SEP_sesam_Glossary#EOL|EOL-free]]) savesets.</translate>
*<translate><!--T:114--> Another way to free up storage space is to remove orphaned savesets from the data stores by using the ''Clean up'' option: Main Selection window -> ''Components'' -> ''Data Stores'' content pane -> option ''Clean up''. This is useful if a data store appears to be inaccessible, its space is occupied, or SEP sesam space check shows non-sesam data.</translate>

<noinclude><div class="noprint">
<translate><!--T:115-->
== See also==
[[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|Configuring Si3 NG Deduplication Store]] – [[Special:MyLanguage/Encrypting_Si3_NG_Deduplication_Store|Encrypting Si3 NG Deduplication Store]] – [[Special:MyLanguage/Standard Backup Procedure|Standard Backup Procedure]] – [[Special:MyLanguage/5_0_0:Restore_Assistant|Restore Assistant]] – [[Special:MyLanguage/Standard Restore Procedure|Standard Restore Procedure]] – [[Special:MyLanguage/Licensing|Licensing]]</translate></div><noinclude>