...
| Codeblock | ||
|---|---|---|
| ||
#!/bin/bash#SBATCH --time 1:00:00
#SBATCH --nodes 1
#SBATCH --tasks-per-node 96
#SBATCH -p standard96
#SBATCH --job-name=of_test_job
#SBATCH --output=outlog/ol-%x.%j.out
#SBATCH --error=outlog/ol-%x.%j.err
export I_MPI_FALLBACK=0
export I_MPI_DEBUG=6
export I_MPI_FABRICS=shm:ofi
export I_MPI_OFI_PROVIDER=psm2
export I_MPI_PMI_LIBRARY=libpmi.so
#--------------------------------------
module load gcc/9.2.0
module load openmpi/gcc.9/3.1.5
module load openfoam/gcc.9/5
# Working Directories
#---------------------
WORKDIR=$TMPDIR/openfoam# initialize OpenFOAM environment
source $WM_PROJECT_DIR/etc/bashrc
. ${WM_PROJECT_DIR:?}/bin/tools/RunFunctions # Tutorial run functions
#---------------
cd $WORKDIR
# run OpenFOAM in parallel
#--------------------------
runApplication decomposePar
runParallel pimpleFoam
#clean the work directory
#----------------------------
rm -rf processor*
1 |
...
Some important advice when running OpenFOAM on a supercomputer
OpenFOAM produces lots of small files. This default behavior jams no only your job but slows down the parallel file system (Lustre) for all HLRN users. Also, you can quickly generate more files than allowed by our quota system (hlrnquota).
...