{"id":3068,"date":"2009-10-08T18:07:14","date_gmt":"2009-10-08T22:07:14","guid":{"rendered":"https:\/\/www.bu.edu\/tech\/research\/scv_import\/computation\/storage\/proj-diskspace\/"},"modified":"2026-06-01T12:59:36","modified_gmt":"2026-06-01T16:59:36","slug":"proj-diskspace","status":"publish","type":"page","link":"https:\/\/www.bu.edu\/tech\/support\/research\/computing-resources\/file-storage\/proj-diskspace\/","title":{"rendered":"Project Disk Space"},"content":{"rendered":"

Overview<\/h2>\n

The Project Disk Space file system comprises twelve petabytes of usable high performance online storage for research computing projects. Project Disk Space is allocated to individual research projects for exclusive use by its members, facilitating collaboration.<\/p>\n

Each project is allocated a limited amount of Free Baseline quota. Those projects requiring additional may either purchase Project Disk through the Buy-in program<\/a> or rent additional Project Disk through the Storage-as-a-Service<\/a> program.<\/p>\n

All Project Disk Space is protected by hardware RAID (protecting against disk failures) and daily Snapshots<\/a> (protect against accidental deletion of files).<\/p>\n

Kinds of Project Disk Partitions<\/h2>\n

There are four Project Disk Space partitions on the SCC: \/project<\/strong>, \/projectnb<\/strong>, \/restricted\/project<\/strong>, and \/restricted\/projectnb<\/strong>. These four partitions have identical performance characteristics. The two \/restricted<\/strong> partitions are dbGaP compliant for data that needs it (primarily Genomics projects). The two \/project<\/strong> partitions are backed up nightly to an independent off-site system for disaster recovery and the two nb<\/strong> partitions are not-backed-up. Regardless, Snapshots<\/a> are implemented on all four partitions enabling users to easily retrieve accidentally deleted files.<\/p>\n

Data Protection Requirements🔗<\/a><\/h2>\n

A portion of the SCC Project Disk Space is set up to be used for processing and storing Confidential data such as a HIPAA Limited Data Set (DOB, DOD, dates of treatment, City, Zip Code) and dbGaP<\/a> data. Restricted Use data<\/strong>, such as HIPAA <\/strong>or individually identifiable health information may not be stored<\/strong> on any partition of the SCC. The allowed Confidential data may be stored only in the \/restricted\/projectnb and \/restricted\/project partitions and can be accessed from all SCC compute nodes but only the\u00a0scc4.bu.edu<\/strong>\u00a0login node and scc-ondemand.bu.edu<\/strong>\u00a0web interface.<\/p>\n

Public<\/strong><\/em> and Internal <\/strong><\/em>data may be stored on \/project and \/projectnb and accessed from the other login nodes as well as all compute nodes.<\/p>\n

Please see http:\/\/www.bu.edu\/policies\/data-classification-policy<\/a>\u00a0 for definitions and more information.<\/p>\n

For questions about how your data is classified, please send email to bumcinfosec@bu.edu<\/a>.For questions about using SCC and Project Disk Space, send email to help@scc.bu.edu<\/a>.<\/p>\n

Allocations<\/h2>\n

Project Disk allocations can be in the form of any of three types: Free, Buy-in, or Storage-as-a-Service. Functionally, rented and purchased Project Disk augment and are largely indistinguishable from free storage.<\/p>\n

Forms for requesting both Free and Storage-as-a-Service space can be found with the other project management web pages on TechWeb on your SCC Management Page<\/a>. For Buy-in space, email buyin@rcs.bu.edu<\/a>.<\/p>\n

Free Baseline Quota🔗<\/a><\/h3>\n

By default, new projects on the SCC are generally created with 200 GB in \/project<\/b> and 800 GB in \/projectnb<\/b>. The Lead Project Investigator (LPI) can specify whether or not it should be dbGaP compliant. Additional Not Backed-Up space can be purchased through either Buy-In<\/a> or Storage-as-a-Service<\/a>. For LPIs with multiple projects, there is an additional limit of a maximum of 3000 GB (with a maximum of 600 GB of that backed up) of Free Baseline quota across all projects.<\/p>\n

Application form: SCC Management Page<\/a><\/p>\n

Purchasing\/Renting Storage through the <\/a>Buy-in and <\/a>Storage-as-a-Service programs🔗<\/a><\/h3>\n

The highly successful Buy-in Program is a convenient way to acquire dedicated storage at highly subsidized rates for an extended period of time (5 years). Any Researcher interested should contact buyin@rcs.bu.edu<\/a> or review the Buy-in options<\/a> web pages. The current cost is [TBD, expected to be ~$100\/Terabyte\/5years].<\/p>\n

The Storage-as-a-Service program offers researchers an option to acquire additional disk quota for a flexible time duration at a subsidized rate of [TBD, expected ~$25\/Terabyte\/year]. Allocations are in whole Terabyte (1000 Gigabyte) units only. To purchase an allocation through this program, the LPI should fill in the request form for Storage-as-a-Service and include their Financial Contact information. The Financial Contact will receive details on how to send an Internal Service Request for transmitting payment. The application form is found on each LPI’s SCC Management Page<\/a>.<\/p>\n

All grant rules apply when using grant funds.<\/p>\n

Buy-in vs Storage-as-a-Service Comparison🔗<\/a><\/strong><\/p>\n

\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
<\/th>\nBuy-in<\/th>\nStorage-as-a-Service<\/th>\n<\/tr>\n<\/tbody>\n
Model<\/b><\/td>\nPurchase<\/td>\nRental<\/td>\n<\/tr>\n
Time Horizon<\/b><\/td>\n5 years<\/td>\n6 months+<\/td>\n<\/tr>\n
Annual Cost<\/b><\/td>\nTBD (expected ~$20\/TB)<\/td>\nTBD (expected ~$25\/TB)<\/td>\n<\/tr>\n
Billing Schedule<\/b><\/td>\nFull five year cost paid up front when large storage array purchase occurs. This is generally 0-4 months after a request comes in.<\/td>\nBilled (and pro-rated for periods less than one year) annually by fiscal year<\/td>\n<\/tr>\n
Minimum Purchase<\/b><\/td>\n10 TB<\/td>\n1 TB<\/td>\n<\/tr>\n
Storage Availability<\/b><\/td>\nGenerally immediately via “Loaner” space until actual purchase but not always<\/td>\nImmediately<\/td>\n<\/tr>\n
Capital Expense?<\/b><\/td>\nYes<\/td>\nNo<\/td>\n<\/tr>\n
Fully fungible\/
\nTransferable between projects<\/b><\/td>\n		Yes<\/td>\nYes<\/td>\n<\/tr>\n
Recommended For<\/b><\/td>\nLarge, long-term purchases<\/td>\nSmall and\/or short term purchases<\/td>\n<\/tr>\n
How to begin purchase?<\/b><\/td>\nEmail buyin@rcs.bu.edu<\/a><\/td>\nSubmit appropriate form on your SCC Management Page<\/a>. Note that only Lead Project Investigators (LPIs) can submit this form, not IT\/Administrative Contacts.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n

Accessing Project Disk Space<\/h2>\n

When a project is created on the SCC, subdirectories will be created for the project under the appropriate \/project<\/b>, \/projectnb<\/b>, \/restricted\/project<\/b><\/span>, and\/or \/restricted\/projectnb<\/b><\/span> directories. These subdirectories will have the same name as the project and will be writable by any member of the project. The structure and access to the files and subdirectories created under the project\u2019s directory is entirely at the discretion of the project members. The Unix \u201cgroup\u201d file permission mechanism can be used to control permissions for the project\u2019s subdirectories (see the man page for \u201cchmod\u201d<\/a> for more details).<\/p>\n

Limitations on Number of Files🔗<\/a><\/h2>\n

In addition to the quota on the total size of your files, there is also a limitation on the number of files you can have. The system does not operate well if people have many millions of very small files. It is much better to have a smaller number of somewhat larger files. This limitation only affects a fairly small number of people. There are three formulas in play for this calculation. If your directory has a file size quota of 16TB or more, you are allowed 2 files per MB of quota. This works out to 33.5 million files at 16TB and 200 million files (which is the maximum allowable in any partition) at 100TB or higher. For smaller allocations, you are allowed 1 file for each 32KB of space you have up to 1 TB or 33 million files. After that, the file quantity limit only goes up after 16TB as explained earlier. Here is a table with the # of files limits for certain quotas.<\/p>\n\n\n\n\n\n\n\n\n
Quota (GB)<\/th>\nQuota (Files)<\/th>\n<\/tr>\n
200<\/td>\n6.5 Million<\/td>\n<\/tr>\n
1,024<\/td>\n33.5 Million<\/td>\n<\/tr>\n
16,384<\/td>\n33.5 Million<\/td>\n<\/tr>\n
100,000<\/td>\n200 Million<\/td>\n<\/tr>\n
200,000<\/td>\n200 Million<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

Quota Enforcement🔗<\/a><\/h2>\n

Project Disk Space quotas on the SCC are enforced by the file system. Daily email reminders are sent to the project’s Lead Project Investigator and all project members to let them know when the project is over its quota, including breaking down how much space each user is using. Projects have a soft limit<\/b> equal to their granted quota and a hard limit<\/b> 10% greater (with a maximum of 100GB over the quota, regardless of its size). Projects can never exceed their hard limit and can only go over their soft limit for a maximum of 7 days. A project over its limit simply needs to delete enough files to get under the soft limit to have full write access restored immediately.<\/p>\n

To help manage the project members\u2019 Project Disk usage, LPIs may specify a limit for each individual researcher. By default, each project member\u2019s limit is set to project\u2019s full allocation. A LPI may reassign individual quotas at any time using the Project Disk Space update form found at the link above. These individual quotas are enforced by the honor system, with email reminders sent daily to the Lead Project Investigator and user who is over his or her personal quota.<\/p>\n

LPIs and users may review a daily record of their project\u2019s and individual Project Disk usage via their SCC Management Page<\/a>; more detailed information is available for LPIs. They may also use the command pquota -u<\/span> projectname<\/span><\/span><\/code><\/a> on the system to see a breakdown of Project Disk usage for a given project.<\/p>\n

Please note that the quota -v<\/span><\/code> command will display a user\u2019s home directory usage, not Project Disk Space usage.<\/p>\n

Two helpful Linux commands for determining disk usage are du<\/span><\/code> and df -h .<\/span><\/code>. Researchers who keep all of their files in their own subdirectory can cd<\/span><\/code> to that directory and type du -sk<\/span><\/code> to display their usage. You can see your project\u2019s overall usage, available space, and hard limit<\/b> quota by running the command df -h .<\/span><\/code> anywhere inside of your group’s appropriate Project Disk Space directory.<\/p>\n

Backed up vs. Not-backed-up Project Disk🔗<\/a><\/h2>\n

Most computational research projects will need a combination of \/project<\/strong> (backed-up) and \/projectnb<\/strong> (not-backed-up) disk space. Files on the \/project<\/strong> partitions are backed up nightly while those on the \/projectnb<\/strong> partitions are not backed up. The \/projectnb<\/strong> partitions are appropriate for most files used in computational research on the SCC.<\/p>\n

Backing up files requires additional resources and expense. We ask that you use the \/project<\/strong> partitions only for files that need to be backed up. These will be restorable in the event of catastrophic failure.<\/p>\n

Files that should be stored in \/project<\/strong> and backed up are those that are being edited (e.g. codes), files that do not have a copy elsewhere, and files that cannot be regenerated.<\/p>\n

Files that should be stored in \/projectnb<\/strong>:<\/p>\n

    <\/ol>\n