Storage and Backups
Home Directory (/home/your_username)
Your home directory sits on a fileserver and is automatically made available (mounted) whenever you log onto one of our systems. Your disk quota varies depending upon the type of account you have. If you run out of space you should first check to see if there are any files that can be deleted. You may check your current usage by logging into the cims portal. For suggestions on how to reduce your disk space usage and/or request an increase in your quota go here. Home directories are backed up daily and should be used to store one's cirtitical work (eg, code and papers).
Web Directory (/web/your_username)
Your web directory sits on a fileserver and is automatically made available (mounted) whenever you log onto one of our systems. The quota here is separate from your home directory quota. Like your home directory quota, your current usage and allotment can be seen by logging into the cims portal. For suggestions on how to reduce your disk space usage and/or request an increase in your quota go here. Like home directories and mail, web directories are backed up daily.
Data Directory (/data/your_username)
A data directory is optional and only supplied upon request and only then if there is a valid reason that the extra space is needed. It is important to note that data directories are not backed up to tape. So the main purpose for a data directory is for large data sets that can be reproduced. This is not to say that these directories are not backed up at all. There are nightly backups but, unlike tape backups which go back months and can contain multiple versions of the same file, these only contain the latest version. Unlike your web directory, there need not be a link under
/home/your_username pointing to
/web/your_username, though, of course, you are welcome to create one. Like your home directory quota, your current usage and allotment can be seen by logging into the cims portal. For suggestions on how to reduce your disk space usage and/or request an increase in your quota go here.
Local Storage on Desktop machines (/scratch on linux and the "C:" drive in Windows)
Every desktop, both Windows and Linux, have local storage for use by the system, but there is also extra space available to the users in the form of sratch directories (/scratch on linux) and the C: drive on Windows desktops. The /scratch directory can be useful for computation on desktop machines and servers along because using the local storage can improve performance for read and write intensive jobs. However, it is important to note that this storage is not backed up, so important results should be copied back to a user's home directory. Similarly, on Windows desktops, the C: drive should only be used as extra strorage on a temporary basis. It is also not backed up.
Other resources at NYU
ITS at NYU offers options such as NYU Box and NYU Drive (also known as Google Drive, part of Google Apps) for storing and sharing files. For a comprehensive list of all of NYU's data storage solutions, click here.
These services are, however only for faculty and staff.
Our suggested client for syncing between Google Drive and linux machines is Insync.
Resources outside of NYU
A number of folks here at Courant use services such as Dropbox, Github and Gitlab to backup, store, or share their data. This practice is not supported and NYU has no official arrangements with these services and is not responsible for the privacy or integrity of any data stored there. It should also be noted that the off the shelf free accounts offered by these sevices are not Ferpa compliant and as such should not be used to store data that comes under such restrictions.
- Dropbox: If you decide to go this route please read the section on Dropbox under Frequently asked Questions.
- Github and Gitlab: Courant does not offer in-house implementaions of these services at this time. We do, however, offer subversion and mecurial repositories. That being said, folks are welcome to set up a self-managed git repository for their own use (in their home directory) that can be accessed remotely via ssh.
Home and Web Directory Backups
The Systems Group maintains both nightly backups to disk and tape backups for both your home directory and your web directory. Feel free to request a restore of older files from tape archives or recently deleted or "corrupted" files from the nightly zfs backups to disk.
Data Directory Backups
The Systems Group maintains a nightly zfs backup of your data directory. If you have just changed/deleted a file and would like to recover the version from the previous backup you could be in luck. Feel free to request a restore of recently deleted or corrupted files from nightly backups.
Note: data directories are not bacled up to tape so older versions of files that are more then a day or 2 old cannot be restored.