Network attached storage devices are boxes that contain both storage and the hardware needed to manage the storage. They can be thought of as a small computer with lots of storage. Using a NAS to store your research data has many benefits. Because they are internet accessible, it is easy to centralize data collected on different instruments and to access data for later analysis. Most models contain multiple hard drives and can be set up with RAID to protect against data loss in case of a hard drive failure. NAS devices are generally affordable ($300-$1500 depending on the storage space needed) and is usually cheaper than purchasing cloud storage over 4-5 years. We currently provide instructions for setting up Synology NAS devices, but many manufacturers make a similar product. If you've got a different NAS, let us know at email@example.com and we can work on putting together setup instructions.
See the instructions for setting up a Synology NAS below.
Interested in trying out a NAS? Send an email to firstname.lastname@example.org to get access to our demo NAS!
Caltech IMSS manages a campus site license for Box.com. Campus users get 50 GB of free storage. Box.com is a good resource for storing backup copies of data and syncing between computers, but should not be used as a primary data storage location. Note that Box.com has a 5 GB individual file limit, and lacks a Linux sync client. Continued availability of Box.com is dependent on IMSS and Box. A comparison of IMSS provided file storage systems is available at http://imss.caltech.edu/services/collaboration-storage-backups/storage-comparison
Have questions about other storage services? Send an email to email@example.com.
IMSS now provides centralized HPC resources via a campus cluster. There is a per-hour charge for computing, and research groups can make an investment to get additional computing time. Find all the details at hpc.caltech.edu
XSEDE is a National Science Foundation funded nationwide high performance computing resource. Researchers can request time on more than 10 national supercomputers, visualization resources, storage systems, and scientific gateways, also listed below. A separate NSF grant is not required to gain access to these resources. Caltech users interested in testing one of these systems can contact the Caltech Campus Champion, Tom Morrell at firstname.lastname@example.org, for trial access. Faculty, Postdoctoral Researchers, and NSF Graduate Research Fellows can submit a startup allocation which provides up to 50,000 compute hours to test XSEDE resources. The startup allocation request process is very straightforward and enables users to quickly access computing resources. After one year or when the startup resources are exhausted, researchers can submit a more thorough research allocation proposal.
Current XSEDE Resources (2020-03)
Labeled with Host, Node specifications, Max queue time
Comet, SDSC, 24 Core; 128 GB RAM; 320 GB SSD, 2 days
Stampede2, TACC, select KNL or SKX: 68 or 48 Core; 96 or 192 GB RAM; 107 or 144 GB SSD, 4 days
Bridges, PSC, 28 core; 128 GB RAM; 8 TB Storage, 2 days (can also schedule segments of a node)
Jetstream, Indiana/TACC, Can spin up various sized custom imaged environments
Open Science Grid, Distributed computing for smaller jobs (single thread, < 2 GB memory, 1-12 hour execution, <10 GB storage)
Cyverse (formerly iplant) is another NSF-funded cyberinfrastructure project that provided computing resources, primarily targeted at life science researchers. They offer free access to Atmosphere, a cloud-based computing resource where you can spin up computing resources with specific images. A basic allocation is available by registering, and additional allocations require an application.
Have questions about high performance computing resources? Send an email to email@example.com.
Tested on a Synology DS216j in Summer 2016. Should apply to all Synology Products that use DSM 6.0. Updated 2018-04.
You should now be in the main control panel of your NAS. You're ready to administer your NAS. A few things you might want to set up are below.
Do you have saved credentials that your Mac is using? Explicitly include your username by connecting to afp://name:*@184.108.40.206/folder