How to use ARC scratch space: Difference between revisions
| Line 12: | Line 12: | ||
For example, if the job ID is '''1234567''', then the directory name will be <code>/scratch/1234567</code>. | For example, if the job ID is '''1234567''', then the directory name will be <code>/scratch/1234567</code>. | ||
If the '''scratch directory''' is '''empty''' at the end of the job, then it '''is deleted automatically''' upon job's completion. | If the '''scratch directory''' is '''empty''' at the end of the job, then it '''is deleted automatically''' upon job's completion. | ||
If, however, the '''scratch directory''' in '''not empty''' and contains some data, when the job finishes, the directory '''is not deleted''' immediately, but instead it is allowed to stay for another 5 days, starting from the time of the job's end, to let the user to move the data to a proper storage location. After '''5 days''' the '''scratch directory''' will be '''automatically deleted''' even if it still contains data. | If, however, the '''scratch directory''' in '''not empty''' and contains some data, when the job finishes, the directory '''is not deleted''' immediately, but instead it is allowed to stay for another '''5 days''', starting from the time of the job's end, to let the user to move the data to a proper storage location. After '''5 days''' the '''scratch directory''' will be '''automatically deleted''' even if it still contains data. | ||
= Links = | = Links = | ||
[[How-Tos]] | [[How-Tos]] | ||
Revision as of 17:12, 19 April 2023
Background
References:
The scratch space provided on ARC is designed to handle large temporary files generated by the job during job's run time.
The scratch space is crated by SLURM when the job starts on the /scratch file systems
as a directory with the name /scratch/<job ID>.
For example, if the job ID is 1234567, then the directory name will be /scratch/1234567.
If the scratch directory is empty at the end of the job, then it is deleted automatically upon job's completion.
If, however, the scratch directory in not empty and contains some data, when the job finishes, the directory is not deleted immediately, but instead it is allowed to stay for another 5 days, starting from the time of the job's end, to let the user to move the data to a proper storage location. After 5 days the scratch directory will be automatically deleted even if it still contains data.