Versionen im Vergleich

Schlüssel

  • Diese Zeile wurde hinzugefügt.
  • Diese Zeile wurde entfernt.
  • Formatierung wurde geändert.

NHR NHR@ZIB is operating at each site 3 central storage systems with their global file systems:

File System

Capacity 

Storage Technology and Function
HOME340 TiB

IBM Spectrum Scale file system, exported via NFS to compute and login nodes

  • includes centrally managed software and the module system in /sw
WORKLise: 10 PiBDDN ExaScaler with Lustre parallel file system
PERM
Tape archive with multiple petabyte capacity with additional harddisk caches

...

  • All nodes of the partition standard96:ssd have local SSDs for temporary data at $LOCAL_TMPDIR (2 TB per node). For more details refer to Special Filesystems.

LIFETIME

In general, we store all data for an extra year after the end of a test account/project. If not extended, the standard term of test account/project is one year.

HOME

Each user holds one HOME directory:

...

The home filesystem and /sw are mounted via NFS, so performance is medium. We take daily snapshots of the filesystem, which can be used to restore a former state of a file or directory. These snapshots can be accessed through the path /home/.snapshots or /sw/.snapshots. There are additional regular backups to restore the filesystem in case of a catastrophic failure.

WORK

The Lustre based work filesystem /scratch is the main work filesystem for the systems. Each user can distribute data to different directories.

...

A general recommendation for network filesystems is to keep the number of metadata operations for open and closing files, as well as checks for file existence or changes as low as possible. These operations often become a bottleneck for the IO of your job and on large clusters can easily overload the file servers.


PERM, tape archive

The magnetic tape archive provides additional storage for inactive data to free up space on the WORK or HOME filesystem. It is directly accessible on the login nodes..

...