Where should I put intermediate files?
Up to Table of Contents
What directory should I put intermediate files in?
If your code requires access to a fast, local filesystem we have provided one for you. This can be good for intermediate or temporary files. You should clean up this directory when your job completes. To maintain a working directory for your job you can use the $JOBID variable. If you use the local filesystem please be sure to copy files that you want back to your home directory.
The following is an example used in a submission script:
mkdir /state/partition1/$JOBID
cd /state/partition1/$JOBID
< do calculation in current working directory >
cp /state/partition1/$JOBID/files_you_want_to_keep $HOME/permanent_dir
rm -rf /state/partition1/$JOBID