Use scratch space

From IBERS Bioinformatics and HPC Wiki
Revision as of 14:47, 7 August 2013 by Mjv08 (talk | contribs) (Created page with "Scratch space is fast access disk that is not backed up. It is located; /ibers/ernie/scratch/username where username is your username. It is here that you should have your...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Scratch space is fast access disk that is not backed up.

It is located;

/ibers/ernie/scratch/username

where username is your username.

It is here that you should have your working data that you're reading from and writing to. This is important for two reasons;

1) It's faster

2) It doesn't get included in the nightly backup

Number 2) is probably the most important. Consider the following;

If you're running a job that is creating lots of temporary files to your home directory, each night these files will be backed up. The backup server has a snapshot functionality which allows the retrival of past deleted files. If these temporary files that your job is creating are deleted often, it means that you might not see them, but they still exist on the backup server. This limits the ability to make lenghy backups of home directories on the HPC.