Versionen im Vergleich

Alte Version 23

changes.mady.by.user Christian Schimmel

Gespeichert am

verglichen mit

Neue Version 24

changes.mady.by.user Christian Schimmel

Gespeichert am

Schlüssel

  • Diese Zeile wurde hinzugefügt.
  • Diese Zeile wurde entfernt.
  • Formatierung wurde geändert.

Inhalt
maxLevel2
typeflat

The NHR@ZIB Next-Generation Technology Pool of systems serves for the exploration and evaluation of new technologies for HPC and AI workloads.

NHR@ZIB has a strong partnership with various vendors sharing the common goal to give experienced userers insights and hands-on to future technologies.

Policies

Notes (Info) Notes on general usage concept (proposal  proposal bySteffen Christgau (Unlicensed) ): Since no resource management system is currently installed, be gentle to other users, take care to not disturb experiments/measurements of others.

...

By default: apass1 is configured in Memory Mode while apass2 is configured in AppDirect Mode. (tbd) If you need a different configuration contact ...who...(CS: Steffen?).

As simple check for the given mode you can run free -h. If the total memory capacity is around or larger than 3 TB the system is in memory mode. Further, if /dev/pmem[01] exists, the AppDirect (or Mixed/Hybrid) mode is in effect.

NOTE CS: eventuell Hersteller Links zu Doku/HW?

Image Added

Hardware

CPU

2x Intel Xeon Platinum 8260L (24c, 2,4 GHz) Cascade Lake SP

SystemInspur NF5280M5
Memory

apass1:

  • 384 GB DDR4 (12 x 32 GB Micron 36ASF4G72PZ-2G9E2 PC4-2933 DIMMs, configured to 2666 MT/s)
  • 3 TB Optane/Apache Pass NVRAM (12 x 258496 MB Intel NMA1XXD512GPSU4, 2666 MT/s)

apass2:

  • 768 GB (12 x 64 GB Samsung M393A8G40MB2-CVF PC4-2933 DIMMs, configured to 2666 MT/s)
  • 6 TB Optane/Apache Pass NVRAM (12 x 514624 MB Intel NMA1XXD512GPSU4 DIMMs, 2666 MT/s)

All DIMM slots fully populated with Optane/DRAM pairs (2:2:2 configuration). The Optane DIMMs are interleaved and a single region spans over them (per socket)

Storage

apass1:

  • 240 GB Intel SSDSC2KB24 SATA,
für
  • for OS/Home
  • 1x 8T Intel SSDPE2KX080T8 NVMe SSD, Scratch (ephemeral, might be wiped/unavailable at any time)

apass2:

  • 240 GB Intel SSDSC2KB24 SATA,
für
  • for OS/Home
  • 2x 8T Intel SSDPE2KX080T8 NVMe SSD, Scratch (ephemeral, might be wiped/unavailable at any time )
NetworkSingle Port Omni-Path HFI Adapter 100 Series (back-to-back connected via Cu cable)

Software

  • OS: Centos7CentOS 7.9
  • more recent software (compilers, libraries, utilities) are available via environment modules (module avail). Module files are stored in /opt/local/modules.

...

NOTE: System software currently updated.

NOTE CS: eventuell Hersteller Links zu HW/Doku?

Image Added

Hardware Configuration

Host
CPU2x Intel Xeon Gold 6126 (12c, 2,6 GHz) Skylake
Host
Memory

192 GB (DDR4-2666 ESS RDIMM)

Accelerators

8x NEC Vector Engines 1.0 (VE) Modell B
(4x per PCI root complex)

VE Configuration

per VE:

  • 8 cores, 1.4 GHz 
  • 48 GB HBM, 1600 MHz, 1.20 TB/s
  • peak pe: 2.15 TFLOPS
Network2x 100 Gb/s IB between the two PCI root complexes

Software

...

  • OS

...

  • : CentOS 7.6
  • VE OS

...

  • : tb
  • NEC Compiler Suite

...

  • : tb


Access

To gain access to the Next-Generation Technology Pool, contact support@hlrn.de. Please give a short description of your intention and the system you want intend to use.