Difference between revisions of "Storage Locations"

[unchecked revision][checked revision]
 
(33 intermediate revisions by 5 users not shown)
Line 1: Line 1:
In storage loactions managment you can view the location of the master database, create new archive stores and manage the archive's individual archive stores.
+
A MailStore archive physically (i.e. on the storage) consists of individual archive stores, each with its own database, search indexes and data containers.<br/>To MailStore users these archive stores are fully transparent; they have access to all archived emails in all active archive stores and thus get a logical view on the archive according to their respective privileges.
  
== Accessing Storage Locations Management ==
+
Under ''Administrative Tools > Storage > Storage Locations'' you can configure the parameters of the archive stores' auto-create, manually create new archive stores and manage the archive's existing archive stores. You can also view the location of the master database here.
 
 
Log on to MailStore Client as MailStore administrator. Click on ''Administrative Tools'' > ''Storage'' and then on ''Storage Locations''.
 
 
 
[[File:tech_storageloc_01.png|center|550px]]
 
 
 
== Changing the Storage Location of the Master Database ==
 
== Changing the Storage Location of the Master Database ==
 +
The storage location of the master database can only be viewed here. In case the MailStore Client is started on the MailStore Server machine, clicking on ''Change...'' closes the MailStore Client and starts the [[MailStore Server Service Configuration]].
  
The storage location of the master database can only be viewed here. Clicking on ''Change...'' closes MailStore Client and starts the [[MailStore Server Service Configuration]].
+
== Archive Store Basics ==
 +
In MailStore, there are two types of archive stores: ''Internal Archive Stores'' and ''External Archive Stores''.
  
= Creating Archive Stores =
+
Internal archive stores are stored entirely in configurable file system directories and can be created, managed and backed up automatically by MailStore. For most environments using internal archive stores is recommended.
 
MailStore distinguishes between two types of archive stores: ''standard archive store'' and ''extended archive store''.
 
  
Standard archive stores are stored entirely in an adjustable directory of the file system. Extended archive stores offer additional options such as storage in SQL databases, but have limited functionality elsewhere. Information about extended archive stores is available in chapter [[Using Extended Archive Stores]].
+
External archive stores offer storage in SQL databases, but have several limitations. Information about external archive stores is available in chapter [[Using External Archive Stores]].
  
<p class="msnote">'''Please note:''' For most environments, using standard archive stores is recommended.</p>
+
Both internal and external archive stores always consist of the following three components:
 +
{{Archive Stores Structure}}
 +
MailStore archive stores as a whole as well as their individual components can be put on different physical storage locations, including network based storages. For additional information, please refer to the article [[Using Network Attached Storage (NAS)]].
  
== Creating a Standard Archive Store ==
+
<p class="msnote">'''Important notice: '''When choosing the physical storage system, please attend to the [[System Requirements]].</p>
  
To create a new standard archive store, please proceed as follows:
+
== Creating Archive Stores ==
 +
In MailStore Server, internal archive stores are created automatically and additionally can be created manually. External archive stores can only be created manually.
  
* In the menu bar on the bottom of the window, click on ''Create...''.
+
=== Creating Internal Archive Stores Automatically ===
* The dialog ''Create New Archive Store'' opens.
+
From time to time, MailStore Server automatically creates a new internal archive store for optimal system performance and stability. The maximum size and amount of emails are determined by MailStore Server internally.
*: [[File:tech_storageloc_std_01.png|center|350px]]
 
 
* Enter a name for the new standard archive store in the ''Name'' field, e.g. ''2012-05''.<br/>'''Please note:'''Remove the checkmark from the box titled ''Archive new messages here'' if you don't want MailStore to archive new emails in the new archive store.
 
+
 
* Using the name entered and the path of the master database MailStore suggests a destination folder for the new standard archive store. To change the proposed path, click on the button next to the ''directory'' field or enter a different path manually.<br/>'''Important notice:''' The destination folder is created automatically. If it already exists, it may not contain any files or subfolders.
 
+
 
* Click on ''Finish'' to create the standard archive store.
 
  
== Creating Standard Archive Stores Automatically ==
+
If needed, you can limit the size that an archive store can reach at most before a new one is created to align with your backup routine. You can also configure the storage location where new archive stores will be created automatically.
  
By default, MailStore Server creates a new standard archive store for every 500,000 emails and archives new emails therein. To change this setting, to create a new standard archive store quarterly, for example, please proceed as follows:
+
<p class="msnote">'''Important notice: '''The maximum size should not be configured manually without good reason, so that MailStore Server can determine the optimal time automatically for creating a new archive store.</p>
  
* Start MailStore Client and log on as MailStore administrator (admin).
+
To change these settings, please proceed as follows:
* Click on ''Administrative Tools'' > ''Storage'' and then on ''Storage Locations''
 
* Click on ''Create automatically...''
 
* Passen Sie die Einstellungen im Dialog ''Archivspeicher automatisch erstellen'' entsprechend Ihren Wünschen an.<br>'''Hinweis:''' Weitere wichtige Informationen finden Sie im Artikel [[Auswahl der richtigen Storagestrategie]].
 
+
 
*: [[File:tech_storageauto_01.png|center|350px]]
 
+
 
* Geben Sie unter ''Erstellen in'' anstelle von C:\MailArchive das Verzeichnis an, unterhalb welchem neue Standard-Archivspeicher angelegt werden sollen. Die von MailStore Server automatisch angelegten Standard-Archivspeicher und damit auch Unterverzeichnisse tragen einen Namen im Format Jahr-Monat, z.B. 2009-04.
 
+
 
* Klicken Sie zum Bestätigen auf ''OK''
 
 
== Erstellen eines erweiterten Archivspeichers ==
 
  
Das Erstellen eines neuen erweiterten Archivspeichers ist unter [[Verwendung erweiterter Archivspeicher]] beschrieben.
+
* Below the list of archive stores, click on the ''Create automatically...'' button.
 +
* [[File:tech_storageauto_01.png|right|350px]]The ''Auto-Create Archive Stores'' dialog opens.
 +
* Customize the settings as preferred.
 +
* Under ''Base directory'' enter the directory below which you want MailStore Server to create the new internal archive stores. The internal archive stores that are created automatically by MailStore Server, including any subfolders, follow the naming scheme ''year-month'', e.g. ''2021-10''.
 +
* ''Optional: ''With the option ''Use different base directories for databases, content and search indexes'' you can configure separate directories for the individual components of an archive store. For example, you can put database and search index on a fast storage to accelerate folder operations and the MailStore search while leaving the email content files on a slower storage.
 +
* Click on ''OK''.<br clear=all />
  
== Maintenance of the Master Database  ==
+
=== Creating an Internal Archive Store Manually ===
 +
To create a new internal archive store manually, please proceed as follows:
  
The following features are available through ''Maintenance'' right of the ''Location'' field.
+
* Below the list of archive stores, click on the ''Create...'' button.
 +
* The ''Create New Archive Store'' wizard opens.
 +
* Select the option ''Internal Archive Store'' and click on ''Next''.
 +
* [[File:tech_storageloc_int_01.png|right|350px]]Enter a name for the new internal archive store in the ''Name'' field, e.g. ''2021-10''.
 +
* If you don't want MailStore to archive new emails in the new archive store, deselect the option ''Archive new messages here''.
 +
* MailStore Server derives a base directory for the new internal archive store from the name entered and the path of the master database. By default, MailStore Server stores all components of an archive store in a folder structure that is created automatically below the base directory. You can optionally either change the proposed path manually or select an existing directory; an existing directory must not contain any files or subfolders.
 +
* ''Optional: ''With the option ''Use different base directories for databases, content and search indexes'' you can configure separate directories for the individual components of an archive store. For example, you can put database and search index on a fast storage to accelerate folder operations and the MailStore search while leaving the email content files on a slower storage.
 +
* Click on ''Finish'' to create the internal archive store.<br clear=all />
  
* '''Cleanup (FB Sweep)'''<br/>Simple cleanup of the master database.
+
=== Creating an External Archive Store ===
* '''Rebuild (FB Backup+Restore)'''<br/>Complete rebuilding of the master database (e.g. if structural problems occur).
+
External archive stores can only be created manually. Creating a new external archive store is described in chapter [[Using External Archive Stores]].
  
== Creating a New File Group ==
+
== Managing Archive Stores ==
 
+
[[File:tech_storageloc_01.png|center|550px]]
To create a new file group, click on ''Create...'' in the menu bar at the bottom of the window. Select an empty directory and click on ''OK'' or just enter a name to create a new file group in the same directory as the master database.
+
=== Setting the Status ===
 
+
Right-click on an archive store and select the status from the ''Set Status'' submenu. As an alternative, you can select an archive store and set the status via the drop-down list in the details pane on the right of the archive store list. You can set the following status:
== Store Newly Archived Email In... ==
 
 
 
Select the file group into which new emails are to be archived. Right-click on the file group and select ''Archive Here''. Only file groups that are not write-protected can be chosen; their status can be changed at runtime.
 
 
 
== Write-Protecting a File Group ==
 
 
 
Select a file group from the list, right-click on it an select ''Write Protect''.
 
 
 
The emails stored in a write-protected file group remain fully available to MailStore users and can be located through the folder structure or by running a search. However, neither can new emails be archived into this file group nor can existing ones be deleted from it. Please keep in mind that the file system still requires write access to the file group.
 
 
 
After a file group has been write-protected, it is marked in the list with a lock symbol next to it.
 
 
 
To remove the write-protection, select the appropriate file group and click on Write Protect again.
 
  
== Attaching and Detaching File Groups ==
+
* ''Archive here''<br/>In MailStore Server, there can only be one archive store with this status. All newly archived emails are written into this archive store. The emails are available to all MailStore users and can be located by searching and through the folder structure. Emails in this archive store can be deleted or moved according to configured user privileges and compliance settings.<br/><br/><p class="msnote">'''Notice: '''If a new internal archive store has been created automatically, its status is initially set to ''Archive here''.<br/>If you set an external archive store's status to ''Archive here'', the automatic creation of internal archive stores will be suspended until you set an internal archive store to this status.</p>
 +
* ''Normal''<br/>Emails in archive stores with status ''Normal'' are available to all MailStore users and can be located by searching and through the folder structure. Emails in this archive store can be deleted or moved according to configured user privileges and compliance settings.
 +
* ''Write-Protected''<br/>Irrespective of user privileges and compliance settings, emails in write-protected archive stores can only be accessed read-only. The emails are available to all MailStore users and can be located by searching and through the folder structure. However, emails in such archive stores cannot be deleted or moved.<br/><br/><p class="msnote">'''Notice: '''Please note that file system write access to the directory of the archive store is still required and that this status prevents automatic processing of retention policies.</p>
 +
* ''Disabled''<br/>Disabling an archive store allows you to make changes to its configuration. This may be necessary after [[Moving the Archive]], for example. While an archive store is disabled, the emails contained therein are not available to the archive.<br/><br/><p class="msnote">'''Notice: '''Please note that this status prevents the execution of archiving profiles.</p>
  
Existing file groups can be detached from the archive: Simply select a file group from the list and right-click on it and select ''Detach'' from the menu. Once detached, the file group and the emails contained therein are no longer available in the archive. This feature can be used for taking old parts of the archive out of storage, for example.
+
=== Editing ===
 +
Through the context menu item ''Edit...'' you can change the name and the directories of an archive store with status ''Disabled''.
  
A detached file group can be reattached to the archive at any time: by clicking ''Attach...'', the file group becomes fully available again. '''Please note:''' Only file groups which originated from the same archive can be attached; file groups from external archives cannot be integrated.
+
=== Renaming ===
 +
Through the context menu item ''Rename...'' you can change the name of an archive store irrespective of its status.
  
== Maintenance of the File Groups ==
+
=== Detaching ===
 +
Through the context menu item ''Detach'' you can detach an archive store from the archive, for example if all email contained therein do no longer have to be archived. The detached archive store and the emails contained therein are no longer available to the archive.
  
All available maintenance commands are available by right-clicking onto a file group from the list. Alternatively by selecting a file group and clicking on ''Selection'' in the menu bar on the bottom of the window. Following functions are available:
+
=== Attaching ===
 +
A detached archive store can be reattached to the archive using the ''Attach...'' button. If the archive store cannot be decrypted automatically, you will be asked for the respective recovery key. For example, this could be the case for archive stores that belonged to another MailStore installation or which have been moved from another machine. You can find more information on the recovery key in section  [[MailStore_Server_Service_Configuration#Security_and_Encryption|Security and Encryption]] of chapter [[MailStore Server Service Configuration]].
  
* '''Free Unused Disk Space'''
+
=== Unlocking ===
* '''Check Data Integrity'''
+
If an archive store cannot be decrypted automatically, it will be listed as ''Locked'' in the list of archive stores. Through the context menu item ''Unlock'' or by changing the status you will be asked for the respective recovery key. You can find more information on the recovery key in section  [[MailStore_Server_Service_Configuration#Security_and_Encryption|Security and Encryption]] of chapter [[MailStore Server Service Configuration]].
* '''Cleanup (FB Sweep)'''<br/>Simple cleanup of a file group database.
 
* '''Rebuild (FB Backup+Restore)'''<br/>Complete rebuilding of a file group database (e.g. if structural problems occur).
 
* '''Recalculate Statistics of all File Groups'''
 
  
== Creating File Groups Automatically ==
+
== Maintenance of Archive Stores ==
 +
All available maintenance commands can be accessed through the context menu of the list of archive stores. Alternatively, you can select an archive store and click on the ''Maintenance'' drop-down list in the details pane. The following commands are available:
  
MailStore Server creates a new file group approximately every 500.000 messages and starts archiving new messages into the newly created file group. To change the default behavior, e.g. you want to create a new file group quarterly, please proceed as follows:
+
* ''Cleanup (Compact)''<br/>Optimizes the data structures while compacting the data.
 +
* ''Check Data Integrity''<br/>Verifies the data integrity between "Folder Information and Meta Data" as well as "Email Headers and Contents".
 +
* ''Maintain All FDB Files''<br/>Maintains the master database and all databases of internal archive stores.
 +
* ''Recalculate all statistics''<br/>Recalculates the statistics (number of emails per archive store) for all archive stores.
  
* Start MailStore Client and log on as MailStore administrator (admin).
+
Maintenance commands can also be scheduled for automatic execution via [[Jobs]].
* Click on ''Administrative Tools'' > ''Storage'' and then on ''Storage Locations''.
 
* Click on ''Create automatically...''.
 
* Adjust the settings in the ''Auto-Create File Groups'' window to your needs.<br/>''Important notice:'' Refer to [[Choosing the Right Storage Strategy]] for additional important information.
 
*: [[File:tech_storageauto_01.png|center|350px]]
 
* Under ''Create in'' enter a path where to create the automatically created file groups directories. MailStore always adds year-month to the name of the file group directory.
 
* Click on ''OK'' to confirm the settings.
 
  
 
[[de:Speicherorte]]
 
[[de:Speicherorte]]
 +
[[en:Storage Locations]]

Latest revision as of 15:53, 28 September 2021

A MailStore archive physically (i.e. on the storage) consists of individual archive stores, each with its own database, search indexes and data containers.
To MailStore users these archive stores are fully transparent; they have access to all archived emails in all active archive stores and thus get a logical view on the archive according to their respective privileges.

Under Administrative Tools > Storage > Storage Locations you can configure the parameters of the archive stores' auto-create, manually create new archive stores and manage the archive's existing archive stores. You can also view the location of the master database here.

Changing the Storage Location of the Master Database

The storage location of the master database can only be viewed here. In case the MailStore Client is started on the MailStore Server machine, clicking on Change... closes the MailStore Client and starts the MailStore Server Service Configuration.

Archive Store Basics

In MailStore, there are two types of archive stores: Internal Archive Stores and External Archive Stores.

Internal archive stores are stored entirely in configurable file system directories and can be created, managed and backed up automatically by MailStore. For most environments using internal archive stores is recommended.

External archive stores offer storage in SQL databases, but have several limitations. Information about external archive stores is available in chapter Using External Archive Stores.

Both internal and external archive stores always consist of the following three components:

  • Folder Information and Meta Data
    Contains all data needed for the construction of the folder structure and the email list.
  • Email Headers and Contents
    Contains the actual payload of the archive.
  • Full Text Index
    Contains all data needed for searching through emails and attachments. The full text index can be reconstructed at any time. Additional information is available in chapter Search Indexes.

MailStore archive stores as a whole as well as their individual components can be put on different physical storage locations, including network based storages. For additional information, please refer to the article Using Network Attached Storage (NAS).

Important notice: When choosing the physical storage system, please attend to the System Requirements.

Creating Archive Stores

In MailStore Server, internal archive stores are created automatically and additionally can be created manually. External archive stores can only be created manually.

Creating Internal Archive Stores Automatically

From time to time, MailStore Server automatically creates a new internal archive store for optimal system performance and stability. The maximum size and amount of emails are determined by MailStore Server internally.

If needed, you can limit the size that an archive store can reach at most before a new one is created to align with your backup routine. You can also configure the storage location where new archive stores will be created automatically.

Important notice: The maximum size should not be configured manually without good reason, so that MailStore Server can determine the optimal time automatically for creating a new archive store.

To change these settings, please proceed as follows:

  • Below the list of archive stores, click on the Create automatically... button.
  • Tech storageauto 01.png
    The Auto-Create Archive Stores dialog opens.
  • Customize the settings as preferred.
  • Under Base directory enter the directory below which you want MailStore Server to create the new internal archive stores. The internal archive stores that are created automatically by MailStore Server, including any subfolders, follow the naming scheme year-month, e.g. 2021-10.
  • Optional: With the option Use different base directories for databases, content and search indexes you can configure separate directories for the individual components of an archive store. For example, you can put database and search index on a fast storage to accelerate folder operations and the MailStore search while leaving the email content files on a slower storage.
  • Click on OK.

Creating an Internal Archive Store Manually

To create a new internal archive store manually, please proceed as follows:

  • Below the list of archive stores, click on the Create... button.
  • The Create New Archive Store wizard opens.
  • Select the option Internal Archive Store and click on Next.
  • Tech storageloc int 01.png
    Enter a name for the new internal archive store in the Name field, e.g. 2021-10.
  • If you don't want MailStore to archive new emails in the new archive store, deselect the option Archive new messages here.
  • MailStore Server derives a base directory for the new internal archive store from the name entered and the path of the master database. By default, MailStore Server stores all components of an archive store in a folder structure that is created automatically below the base directory. You can optionally either change the proposed path manually or select an existing directory; an existing directory must not contain any files or subfolders.
  • Optional: With the option Use different base directories for databases, content and search indexes you can configure separate directories for the individual components of an archive store. For example, you can put database and search index on a fast storage to accelerate folder operations and the MailStore search while leaving the email content files on a slower storage.
  • Click on Finish to create the internal archive store.

Creating an External Archive Store

External archive stores can only be created manually. Creating a new external archive store is described in chapter Using External Archive Stores.

Managing Archive Stores

Tech storageloc 01.png

Setting the Status

Right-click on an archive store and select the status from the Set Status submenu. As an alternative, you can select an archive store and set the status via the drop-down list in the details pane on the right of the archive store list. You can set the following status:

  • Archive here
    In MailStore Server, there can only be one archive store with this status. All newly archived emails are written into this archive store. The emails are available to all MailStore users and can be located by searching and through the folder structure. Emails in this archive store can be deleted or moved according to configured user privileges and compliance settings.

    Notice: If a new internal archive store has been created automatically, its status is initially set to Archive here.
    If you set an external archive store's status to Archive here, the automatic creation of internal archive stores will be suspended until you set an internal archive store to this status.

  • Normal
    Emails in archive stores with status Normal are available to all MailStore users and can be located by searching and through the folder structure. Emails in this archive store can be deleted or moved according to configured user privileges and compliance settings.
  • Write-Protected
    Irrespective of user privileges and compliance settings, emails in write-protected archive stores can only be accessed read-only. The emails are available to all MailStore users and can be located by searching and through the folder structure. However, emails in such archive stores cannot be deleted or moved.

    Notice: Please note that file system write access to the directory of the archive store is still required and that this status prevents automatic processing of retention policies.

  • Disabled
    Disabling an archive store allows you to make changes to its configuration. This may be necessary after Moving the Archive, for example. While an archive store is disabled, the emails contained therein are not available to the archive.

    Notice: Please note that this status prevents the execution of archiving profiles.

Editing

Through the context menu item Edit... you can change the name and the directories of an archive store with status Disabled.

Renaming

Through the context menu item Rename... you can change the name of an archive store irrespective of its status.

Detaching

Through the context menu item Detach you can detach an archive store from the archive, for example if all email contained therein do no longer have to be archived. The detached archive store and the emails contained therein are no longer available to the archive.

Attaching

A detached archive store can be reattached to the archive using the Attach... button. If the archive store cannot be decrypted automatically, you will be asked for the respective recovery key. For example, this could be the case for archive stores that belonged to another MailStore installation or which have been moved from another machine. You can find more information on the recovery key in section Security and Encryption of chapter MailStore Server Service Configuration.

Unlocking

If an archive store cannot be decrypted automatically, it will be listed as Locked in the list of archive stores. Through the context menu item Unlock or by changing the status you will be asked for the respective recovery key. You can find more information on the recovery key in section Security and Encryption of chapter MailStore Server Service Configuration.

Maintenance of Archive Stores

All available maintenance commands can be accessed through the context menu of the list of archive stores. Alternatively, you can select an archive store and click on the Maintenance drop-down list in the details pane. The following commands are available:

  • Cleanup (Compact)
    Optimizes the data structures while compacting the data.
  • Check Data Integrity
    Verifies the data integrity between "Folder Information and Meta Data" as well as "Email Headers and Contents".
  • Maintain All FDB Files
    Maintains the master database and all databases of internal archive stores.
  • Recalculate all statistics
    Recalculates the statistics (number of emails per archive store) for all archive stores.

Maintenance commands can also be scheduled for automatic execution via Jobs.