Source:About Replication - Jaglion: Difference between revisions

From SEPsesam
m (Corrected links to FAQ)
(Update related to Si3 deprecated store (replication to S3 explained to work only with old generation Si3))
Line 17: Line 17:
<translate>
<translate>
<!--T:109-->
<!--T:109-->
See also: [[Special:MyLanguage/Replication_Best_Practices|Replication Best Practices]] – [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] – [[Special:MyLanguage/S3_Cloud_Storage_Backup|S3 Cloud Replication]] – [[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]] – [[Special:MyLanguage/Monitoring_and_Reporting|Monitoring and Reporting]]</translate>  
See also: [[Special:MyLanguage/Replication_Best_Practices|Replication Best Practices]] – [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] – [[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]] – [[Special:MyLanguage/Monitoring_and_Reporting|Monitoring and Reporting]] – [[Special:MyLanguage/4_4_3_Grolar:S3_Cloud_Storage_Replication|S3 Cloud Replication]] ''(only old Si3 store)'' </translate>  
|}
|}


Line 53: Line 53:
|}</div>
|}</div>
<translate><!--T:116-->
<translate><!--T:116-->
SEP sesam provides different replication types. The '''SEP Si3 replication''' enables you to replicate data between SEP sesam Remote Device Servers. You can also use '''HPE Catalyst stores''', '''HPE Cloud Bank Storage''','''HPE Cloud Volumes''' (in v. [[SEP_sesam_Release_Versions|≥ 5.0.0 ''Jaglion'']]) and '''S3 cloud storage''' for replicating your data.
=== Replication types ===
SEP sesam provides different types of replication: '''basic Si3 replication''' enables you to replicate data between SEP sesam Remote Device Servers. You can also use replication based on '''HPE Catalyst store''', '''HPE Cloud Bank Storage''' and '''HPE Cloud Volumes''' (in v. [[SEP_sesam_Release_Versions|≥ 5.0.0 ''Jaglion'']]). For details, see [[Special:MyLanguage/4_4_3_Beefalo:HPE_StoreOnce_Replication|HPE StoreOnce Replication]].
<br />In previous releases, you could also '''replicate to S3 Cloud storage''' using old generation Si3 store. In v. [[SEP_sesam_Release_Versions|≥ 5.0.0 ''Jaglion'']], instead of using the old way of replicating to S3 Cloud, SEP recommends using the new generation Si3 NG store, which allows you to [[Special:MyLanguage/5_0_0:Si3_NG_Direct_to_S3|'''back up your data directly to S3 Cloud''']] (replication to S3 Cloud is not supported with Si3 NG).


=== How it works ===
<!--T:2-->
<!--T:2-->
SEP sesam replication only searches for new blocks of data in the source media pool and replicates these changes to a target media pool on a set schedule. Replication means that only changed data blocks are sent over a network and replicated to the target server. This reduces the data transferred over the network and gives you the ability to control your network usage by scheduling replication.  
SEP sesam replication only searches for new blocks of data in the source media pool and replicates these changes to a target media pool on a set schedule. Replication means that only changed data blocks are sent over a network and replicated to the target server. This reduces the data transferred over the network and gives you the ability to control your network usage by scheduling replication.  
Line 90: Line 93:


<!--T:123-->
<!--T:123-->
The first step in configuring replication is to configure the data stores. Depending on the replication type, select the relevant ''data store type'':</translate>
The first step in configuring replication is to configure the data stores. Depending on the replication type, select the relevant ''data store type''.</translate>  
*<translate><!--T:124--> '''''Si3 deduplication store''''': Enables you to replicate the data between SEP sesam Remote Device Servers ([[Special:MyLanguage/SEP_sesam_Glossary#RDS|RDS]]), which can also be [[Special:MyLanguage/SEP_sesam_Glossary#SEP_sesam_Server|SEP sesam Servers]], or to S3 cloud. For details, see [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] and [[Special:MyLanguage/S3_Cloud_Storage_Backup|S3 Cloud Replication]].</translate>
<translate><!--T:137--> {{tip|As of SEP sesam v. [[Special:MyLanguage/SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']], two Si3 data store types are available. SEP sesam recommends using the new generation Si3 NG when creating a new data store. Si3 NG is advantageous over the older Si3 store type because it provides better performance and resource savings, and allows you to back up your data [[Special:MyLanguage/5_0_0:Si3_NG_Direct_to_S3|directly to S3 cloud storage]]. For more details, see [[Special:MyLanguage/5 0 0:Configuring Si3 NG Deduplication Store|Configuring Si3 NG Deduplication Store]].}}</translate>
*<translate><!--T:125--> '''''HPE StoreOnce''''': Enables you to replicate the data between SEP sesam backup server (SEP sesam Server or RDS) and Catalyst store, or between one Catalyst store to another. For details, see [[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]].</translate>
*<translate><!--T:126-->
'''''HPE Cloud Bank Store''''': Enables you to replicate the data between Catalyst store and Cloud Bank store. For details, see [[Special:MyLanguage/HPE_StoreOnce_Replication#cloud_bank_store|Creating HPE StoreOnce Cloud Bank store]].</translate>  
 
<translate><!--T:138--> [[Image:data_store_si3NG.jpg|400px|link=]]</translate>  
<translate><!--T:138--> [[Image:data_store_si3NG.jpg|400px|link=]]</translate>  
<br clear=all>
<br clear=all>
<ul><li><translate><!--T:124--> '''''Si3 NG deduplication store''''': Enables you to replicate data between SEP sesam Remote Device Servers ([[Special:MyLanguage/SEP_sesam_Glossary#RDS|RDS]]), which can also be [[Special:MyLanguage/SEP_sesam_Glossary#SEP_sesam_Server|SEP sesam Servers]].</translate></li>
<translate><!--T:137--> {{note|As of SEP sesam v. [[SEP_sesam_Release_Versions|5.0.0 ''Jaglion'']], two Si3 deduplication store types are available (Si3 and Si3 NG). It is strongly recommended to use the [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store|newer type SEP Si3 NG deduplication store]] as the old generation Si3 deduplication store is deprecated. [[Special:MyLanguage/4_4_3_Grolar:S3_Cloud_Storage_Replication|Replication to S3 Cloud]] is only possible with the old generation Si3 store. Instead of using the old way of replicating to S3 Cloud, SEP recommends using the [[Special:MyLanguage/5 0 0:Configuring Si3 NG Deduplication Store|new generation Si3 NG store]], which allows you to [[Special:MyLanguage/5_0_0:Si3_NG_Direct_to_S3|'''back up your data directly to S3 Cloud''']] (replication to S3 Cloud is not supported with Si3 NG).}}</translate>
<li><translate><!--T:125--> '''''HPE StoreOnce''''': Enables you to replicate data between SEP sesam backup server (SEP sesam Server or RDS) and Catalyst store, or between one Catalyst store to another. For details, see [[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]].</translate></li>
<li><translate><!--T:126-->
'''''HPE Cloud Bank Store''''': Enables you to replicate data between Catalyst store and Cloud Bank store. For details, see [[Special:MyLanguage/HPE_StoreOnce_Replication#cloud_bank_store|Creating HPE StoreOnce Cloud Bank store]].</translate></li></ul>


<translate><!--T:127-->
<translate><!--T:127-->
Afterwards, you have to [[Special:MyLanguage/Configuring a Media Pool|create media pools]], [[Special:MyLanguage/Creating_a_Backup_Task|test your backups]] and create a replication task:
Afterwards, you have to [[Special:MyLanguage/Configuring a Media Pool|create media pools]], [[Special:MyLanguage/Creating_a_Backup_Task|test your backups]], and create a replication task:
*[[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]]  
*[[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]]  
<!--T:140-->
*[[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]]


<!--T:139-->
<!--T:139-->
*[[Special:MyLanguage/S3_Cloud_Storage_Backup|S3 Cloud Replication]]
*<span style="color:red">S3 Cloud Replication (see note!)</span> (described in [[Special:MyLanguage/4_4_3_Grolar:S3_Cloud_Storage_Replication|S3 Cloud Replication]]) </translate>


<!--T:140-->
{{<translate>note</translate>|<translate>The old generation Si3 deduplication store is deprecated. '''SEP strongly recommends using the new Si3 NG data store instead, especially if data is to be stored to S3 Cloud.'''</translate>
*[[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]]  
*<translate>If you are using an old generation Si3 deduplication store with S3, you will not be able to restore from S3 using the GUI.</translate>
*<translate>You can configure a new Si3 NG and an old Si3 in parallel on the same host and replicate from the old Si3 to the Si3 NG store. For details, see [[Special:MyLanguage/5_0_0:Configuring_Si3_NG_Deduplication_Store#upgrade|Configuring Si3 NG Deduplication Store]].</translate>
*<translate>Then you can [[Special:MyLanguage/5_0_0:Si3_NG_Direct_to_S3|back up your data directly to S3 Cloud]].</translate>}}


<!--T:141-->
<translate><!--T:141-->
You can [[Special:MyLanguage/4_4_3_Beefalo:About_Replication#scheduling|schedule a replication job]] or [[Special:MyLanguage/4_4_3_Beefalo:About_Replication#initial|start the process manually]].</translate></noinclude>
You can [[Special:MyLanguage/4_4_3_Beefalo:About_Replication#scheduling|schedule a replication job]] or [[Special:MyLanguage/4_4_3_Beefalo:About_Replication#initial|start the process manually]].</translate></noinclude>


Line 212: Line 219:
<div class="noprint">
<div class="noprint">
<translate>== See also == <!--T:136-->
<translate>== See also == <!--T:136-->
[[Special:MyLanguage/Replication_Best_Practices|Replication Best Practices]] – [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] – [[Special:MyLanguage/S3_Cloud_Storage_Backup|S3 Cloud Replication]] – [[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]] – [[Special:MyLanguage/Monitoring_and_Reporting|Monitoring and Reporting]]
[[Special:MyLanguage/Replication_Best_Practices|Replication Best Practices]] – [[Special:MyLanguage/SEP_Si3_Replication|SEP Si3 Replication]] – [[Special:MyLanguage/HPE_StoreOnce_Replication|HPE StoreOnce Replication]] – [[Special:MyLanguage/Monitoring_and_Reporting|Monitoring and Reporting]] – [[Special:MyLanguage/4_4_3_Grolar:S3_Cloud_Storage_Replication|S3 Cloud Replication]] ''(only old Si3 store)''
</div></noinclude></translate>
</div></noinclude></translate>

Revision as of 11:40, 30 June 2022

Other languages:

Template:Copyright SEP AG en

Docs latest icon.png Welcome to the latest SEP sesam documentation version 4.4.3 Beefalo/5.0.0 Jaglion. For previous documentation version(s), check documentation archive.


Overview

Replication types

SEP sesam provides different types of replication: basic Si3 replication enables you to replicate data between SEP sesam Remote Device Servers. You can also use replication based on HPE Catalyst store, HPE Cloud Bank Storage and HPE Cloud Volumes (in v. ≥ 5.0.0 Jaglion). For details, see HPE StoreOnce Replication.
In previous releases, you could also replicate to S3 Cloud storage using old generation Si3 store. In v. ≥ 5.0.0 Jaglion, instead of using the old way of replicating to S3 Cloud, SEP recommends using the new generation Si3 NG store, which allows you to back up your data directly to S3 Cloud (replication to S3 Cloud is not supported with Si3 NG).

How it works

SEP sesam replication only searches for new blocks of data in the source media pool and replicates these changes to a target media pool on a set schedule. Replication means that only changed data blocks are sent over a network and replicated to the target server. This reduces the data transferred over the network and gives you the ability to control your network usage by scheduling replication.

To optimize replication performance, you cannot replicate savesets with errors. It is possible to replicate savesets with status successful, savesets with warnings (status successful or with warnings) or partially restorable savesets (containing data from cancelled backups).

Prerequisites

To ensure error-free operation of SEP sesam and improve performance, make sure that the following conditions are met:

  • SEP sesam Server v. ≥ 4.4.3 Beefalo.
  • Check the hardware requirements for SEP sesam Server and RDS.
  • Depending on your environment (Si3R, HPE StoreOnce VSA, Cloud Storage), an appropriate license is required to use replication. For details, see Licensing.
  • A reliable network connection between the servers. Note that the NAT (Network Address Translation) infrastructure is not supported.
  • The bandwidth may affect replication performance. Test the SEP sesam replication processing to determine how much workload can be managed by your network.
  • If replicating to Si3 deduplication store, it is important that you ensure a sufficient amount of memory and CPU; check the system requirements and recommendations.
  • The same amount of disk space is required for source and target data stores. Ensure there is enough disk space available for both data stores, always keeping in mind that horizontal scaling may be required.
  • Determine the type of data to be replicated. You can reduce the network load by elaborate scheduling and replication scenarios.
Information sign.png Note
Antivirus programs may disrupt network communication and cause SEP sesam processes, such as backup and replication, to fail. One program that is known to cause SEP sesam processes to terminate is Sophos Firewall with IPS (Intrusion Prevention System) enabled. Make sure that there are no antivirus, firewall, IDS or IPS programs preventing interaction with SEP sesam.

Configuring replication

The replication configuration is quite simple and does not differ significantly between replication types. However, each replication type has its own requirements, e.g. certain licencing and pre-configuration steps, data store type, etc. Depending on which replication type you want to use, refer to the relevant documentation (links in the list below).

The first step in configuring replication is to configure the data stores. Depending on the replication type, select the relevant data store type. Data store si3NG.jpg

Afterwards, you have to create media pools, test your backups, and create a replication task:

Information sign.png Note
The old generation Si3 deduplication store is deprecated. SEP strongly recommends using the new Si3 NG data store instead, especially if data is to be stored to S3 Cloud.

You can schedule a replication job or start the process manually.

Initial replication

  • When data is transferred for the first time, all data is replicated from the source to the destination server. Therefore, the initial replication requires a larger amount of CPU, network bandwidth and time to complete successfully.
  • You should start the first replication manually. After the initial replication is completed, all subsequent replications will only transfer the data that has changed on the source server.
  • All subsequent replication cycles should be scheduled to start automatically (see the following section Scheduling replication).

To start replication manually, proceed as follows:

  1. In the GUI menu, select Activities -> Immediate start -> Replication (previously Migration).
  2. In the Immediate Start: Replication window, from the Task name drop-down list select the replication task you want to start and click Start.
  3. Immediate start-replication.jpg

To ensure that the replication is successful, check its status as described in Checking replication status below.

Scheduling replication

You can add your replication task to one or more schedules to automate your replication.

  1. From Main Selection -> Scheduling -> Schedules, click New Schedule. The New Schedule window appears.
  2. New replication schedule.jpg
  3. Configure your schedule and click OK. For details, see Creating a schedule.
  4. Right-click the schedule you have just created and select New Replication Event. The New Replication Event window opens.
  5. From the Task name drop-down list, select the task you want to link to the schedule. Optionally, under Sequence control, set up the Priority of your replication event. SEPuler always executes the schedules with higher priority first. Default priority level is 1, which is the lowest priority (the highest is 99). The only exception are the schedules with priority 0, which override all other priorities and are always executed. For details, see Setting Event Priorities. You can also enable the Blocking date, see Special Schedules.
  6. Click OK to link the event to the schedule. New replication event.jpg

Checking replication status

You can view the status of your replications in the GUI (Job State -> Migrations and Replications) or SEP sesam Web UI (Monitoring -> Replications).

Checking replication in GUI

The status of your replication jobs is logged together with the migration jobs. Go to the Main Selection -> Job state -> and look for your replication task in the first column Migration Task. The other columns provide details on status, start and end time, the amount of data being transferred, etc. For example, you may be replicating 100 GB of data (column Data Size), but only 1 GB is transferred physically (column Transferred) over the network as only a small amount of data is changed.

By default, the replication tasks are listed in the tree view. Expanding the replication task by clicking plus (+), shows the status of individual replication tasks grouped together in a hierarchical view.

You can view the details of a specific migration or replication task by double-clicking it (or by selecting it and clicking the Properties button). You can also check the log file for details by selecting the Main Log tab, and then send or download the log(s).

Migrations by state Beefalo.jpg

Information sign.png Note

If the replication is scheduled, but there is nothing to replicate because the data has not changed since the last run, the displayed status in the column State is successful with remark no savesets found.

Checking replication in Web UI

As of 4.4.3 Beefalo V2, you can also monitor your replications via Web UI. To do this:

  • simply enter the following information in address bar of the browser: http://[servername]:11401/sep/ui or https://[servername]:11401/sep/ui or
  • open from the GUI by clicking the first icon – dashboard – in the toolbar or
  • select Dashboard in Main Selection -> Monitoring.

The replications view shows an overview of replication task results and allows you to customize the view according to your filters. Tasks are listed with the following details: clickable task name, status, start and end time, clickable sesam date, clickable message, source and target media pool, data size, etc.

  • You can filter replications by date using the date range selector and different filter buttons in the upper right corner (results by state, replication type, replication task).
  • You can set different options by clicking the more options icon (3 vertical dots) in front of the replication task name. You can review task properties, use various filters, download your logs as a ZIP file, etc.

Monitoring replications Jaglion.jpg