...
For single node IO this is the best performing filesystem to use.
Lise: SSD | Lise: CAS | Emmy | |
---|---|---|---|
Access | via queue: standard:96:ssd using $LOCAL_TMPDIR | via queue large96:ssd and huge96:ssd using $LOCAL_TMPDIR | via queue medium96 using $LOCAL_TMPDIR |
Type and size | Intel NVMe SSD DC P4511 (2 TB) | Intel NVMe SSD DC P4511 (2 TB) using Intel Optane SSD DC P4801X (200 GB) as writhe-trough cache | Intel DC S4500 (400 GB) |
FastIO - Lise only
Additional 4 OST's using NVMe SSDs integrated into WORK.
...
Size: 55 TiB - quoted
IME - Emmy only
---
Access: IME Burst Buffer, File System Cache
Size:
Finding the right filesystem
...
The maximum performance gain on IO versus $WORK is mentioned in brackets.
small random IO | lots of large IO per process | few large IO shared across nodes | unknown IO | |||||
---|---|---|---|---|---|---|---|---|
local IO | global IO | local IO | global IO | local IO | global IO | local IO | global IO | |
write IO | Local SSDs (+100%) | FastIO stripe=4 (+30%) | Local SSDs (+15%) | $WORK | $WORK | FastIO stripe=4 (+200%) or $WORK stripe=4-8 (+200%) | Local SSDs (+40%) | FastIO stripe=4 (+80%) $WORK stripe=4-8 (+70%) |
read IO | Local SSDs (+30%) | FastIO (+140%) | Local SSDs (+30%) | FastIO stripe=4 (+20%) | Local SSDs (+35%) | FastIO stripe=4 (+200%) | Local SSDs (+30%) | FastIO stripe=4 (+120%) $WORK stripe=MAX (+90%) |
balanced IO | Local SSDs (+60%) | FastIO stripe=4 (+90%) | Local SSDs (+25%) | FastIO (+15%) | Local SSDs (+20%) | FastIO stripe=4 (+200%) or $WORK stripe=MAX (+150%) | Local SSDs (+35%) | FastIO stripe=4 (+100%) FastIO (+50%) |
Vorschlag Ankündigung
Subj: additional WORK filesystems available
Dear HLRN Users
to achieve better IO performance HLRN has installed additional filesystems tailored for dedicates IO demands.
LISE has now node-local SSDs using NVMe and Optane to accelerate local IO. Furthermore we have installed a SSD based Lustre called 'FastIO'.
EMMY is upgraded with an IME.....
If your jobs have a significant amount of IO which can be accelerated visit: _________ or contact our support.
Kind Regards
HLRN-Team
...