Atlassian uses cookies to improve your browsing experience, perform analytics and research, and conduct advertising. Accept all cookies to indicate that you agree to our use of cookies on your device. Atlassian cookies and tracking notice, (opens new window)
User Manual

User Manual
Results will update as you type.
  • Application Guide
  • Status of System
  • Usage Guide
    • SSH Login
    • Data Transfer
    • File Systems
    • MPI, OpenMP build and run workflows
    • Slurm usage
  • Compute partitions
  • Software
  • FAQ
  • NHR Community
  • Contact

    You‘re viewing this with anonymous access, so some content might be blocked.
    /
    Data Transfer

    Data Transfer

    Nov. 29, 2024

    The NHR systems in Berlin are equipped with various file systems each. Their properties and their intended utilization are described here.

    Disk quotas based on group ownerships are implemented on each site's global (non-local) file systems.

    We support file transfer tools like scp or rsync which use the SSH protocol in the background to establish the connection and to encrypt the data transfer. For this reason, a working SSH connection is a prerequisite for data transfer. Each of the following sections deals with a specific direction for establishing the transfer connection. Independent of the connection direction, data can always be transferred "from" or "to" the connected target host.

    Data Transfer Connecting from the Outside World

    External connections to the NHR systems in Berlin require that an SSH key pair is used for authentication. More details can be found here. The location of the private key file can be specified when calling scp or rsync on the user's local machine. Some examples including both data transfer directions are shown below.

    Using scp, the option -i <fullpath_of_privatekeyfile> can be added:

    Example 1: Using scp to copy data from Lise to the user's local machine
    $ scp -i <fullpath_of_privatekeyfile> <username>@blogin.nhr.zib.de:<remote_source> <local_target>
    Example 2: Using scp to copy data from the user's local machine to Lise
    $ scp -i <fullpath_of_privatekeyfile> <local_source> <username>@blogin.nhr.zib.de:<remote_target>

    With rsync, the nested option -e 'ssh -i <fullpath_of_privatekeyfile>' can be added: 

    Example 3: Using rsync to copy data from Lise to the user's local machine
    $ rsync -e 'ssh -i <fullpath_of_privatekeyfile>' <username>@blogin.nhr.zib.de:<remote_source> <local_target>
    Example 4: Using rsync to copy data from the user's local machine to Lise
    $ rsync -e 'ssh -i <fullpath_of_privatekeyfile>' <local_source> <username>@blogin.nhr.zib.de:<remote_target>


    (Glühbirne) Alternatively, the additional options shown above for specifying the location of the private key file can be omitted. In this case it is necessary to have a corresponding SSH configuration on the user's local machine as described here. To verify this, the corresponding SSH connection must be working without specifying the private key file on the command line.

    Data Transfer Connecting to the Outside World

    Connections to external machines located anywhere in the world can be established interactively from the login nodes. In this case, the SSH key pair mentioned above for external connections to the login nodes is not required. However, additional rules imposed by the external host or institution may apply.

    Data transfer in the context of a batch job is restricted due to limited network access of the compute nodes. Please send a message to the support mailing list in case you need further help.

    , multiple selections available,
    {"serverDuration": 11, "requestCorrelationId": "19403654d6ec4d60a90396ff2d4ae3fd"}