If your project needs larger quotas, please contact your consultant to discuss your needs and how we can help you.

...

Please periodically check whether your scientific results data stored on HLRN the file systems should be periodically transferred to the user's home institution. To maintain good I/O performance for all user jobs, the usage of the shared file systems of the HLRN  for all resources needs to be limited.

...

The default values for user quota are reasonable for average use cases. We are aware that certain projects need larger quota for their workflows. If your project needs larger quotas, please contact your consultant to discuss your needs and how we can help you.

File system quotas at HLRN are enforced

• on HOME and WORK with respect to group ownerships
• on PERM with respect to user ownerships on Lise in Berlin
• on PERM with respect to group ownerships for block and storage location (user or project directory) for inode on Emmy in Göttingen

...

^✦ there is user ownership only

Quota is available on the three file systems HOME, WORK and PERM. On each file system we distinguish

...

Check your disk quota limits using the command hlrnquota show-quota. If your user ID is member of one or more project groups you will also get quota information for these project groups. Each of your files and directories is owned by your user ID (user ownership) and by exactly one of the group IDs you are a member in (group ownership). The data base for the output of hlrnquota show-quota is updated twice per hour.

blogin4blogin7:~ $ hlrnquotashow-quota
Home
                           Blocks used   Soft limit   Hard limit     Inodes used   Soft limit   Hard limit    
  myaccount  (users)          89.45 GiB       40 GiB      100 GiB         187.3 k            -            -    
  prj00012  (projects)        68.03 GiB       40 GiB      100 GiB         659.6 k            -            -    

Work
                           Blocks used   Soft limit   Hard limit     Inodes used   Soft limit   Hard limit    
  myaccount  (users)          1.202 TiB        3 TiB       30 TiB          1.74 k        250 k        1.5 M    
  prj00012  (projects)        2.512 TiB       12 TiB       30 TiB               1          1 M          6 M    

...

For each file and directory stored on the HOME and or WORK file systems, its :

The group ownership affects the disk quotas quota of that particular group – no matter where the file or directory itself is located in a given within file system.

Sometimes this can make it hard to track down the disk quota when files or directories of a given group ownership are distributed over different top-level user directories and/or project directories.

...

blogin4:~ $ chgrp prj00012 somefile.txt
blogin4:~ $ ls -l somefile.txt
-rw-------  1 myaccount prj00012 237271040 Jul  3  2020 somefile.txt

To change all small number of files in a directory recursively, use "chgrp -R".  To update many files, especially on the Lustre filesystems, you should use "lfs find" instead:

blogin4:~ $ lfs find somedirectory | xargs chgrp --recursive prj00012 somedirectory
blogin4:~ $ ls -ld somedirectory
drwx------  1 myaccount  prj00012      4096 Jul  3  2020 somedirectory

If your file or directory names contain spaces, you will need to use "lfs find -0 ... | xargs -0 ..." instead.

Access for group members

Once a file (or a complete directory) has the group ownership, the file might have open access for be accessed by all users in the group.

blogin4:~ $ ls -lal somefile.txt
-rw-------  1 myaccount prj00012 237271040 Jul  3  2020 somefile.txt
blogin4:~ $ chmod g+r somefile.txt
blogin4:~ $ ls -lal somefile.txt
-rw-r-----  1 myaccount prj00012 237271040 Jul  3  2020 somefile.txt

...

blogin4:~ $ ls -ld somedirectory
drwx------  1 myaccount  prj00012      4096 Jul  3  2020 somedirectory
blogin4:~ $ lfs chmod --recursivefind somedirectory |xargs chmod g+rX
somedirectory
blogin4:~ $ ls -ld somedirectory
drwxr-x---  1 myaccount  prj00012      4096 Jul  3  2020 somedirectory

...

blogin4:~ $ lfs find /home/myaccount/somedirectory | wc -l
201

Related articles