Protected Environment (PE) at CHPC
This page refers to the refreshed PE that was funded partially by a NIH Shared Instrumentation Grant (1S10OD021644-01A1) Award received April 2017. The award allowed CHPC to deploy a complete refresh of the existing PE, and in the process expand the capabilities and increase the security relative to the initial CHPC PE deployment. In addition, the refreshed PE is configured to allow for expansion in a condominium fashion, in both the storage and in the HPC components. The different components of the new PE were made accessible to users as they were deployed, most during the first quarter of 2018.
CHPC operates a protected environment (PE) for researchers with sponsored research projects and work with data that is sensitive in nature, including projects involving human genomic data. These resources have been reviewed and vetted by the Information Security Office and the Compliance Office as being an appropriate place to work with Protected Health Information (PHI). If you have data that has other compliance requirements, please let us know well in advance so that we may ensure that our PE meets the requirements needed for your project. Please follow the recommendations below when requesting access to a resource in the PE.
NOTE: If you decide to work with protected &/or regulated data outside of CHPC's designated protected environment please know that you'll need to investigate any required agreement(s) that must be in place in accordance with the HIPAA privacy rule prior to creating, processing, maintaining, or transmitting ePHI/PII (protected health information &/or personally Identifiable info), such as a Business Associate Agreement or, in the case of research purposes, a valid IRB or other agreement, as appropriate. The Privacy Office contact information can be found at http://privacy.utah.edu/and IRB office at http://irb.utah.edu/ for guidelines and more information. If CHPC resources are used, we will assist you with the requirements. NOTE: A list of existing BAA's with the UofU (for those allowed via role based security) can be found via the following URL: https://pulse.utah.edu/site/comser/infpriv/Pages/Business-Associates.aspx
- Only CHPC Staff system administrators will have root to hosts in the protected environment.
- Only sponsored research projects with HIPAA/PHI or other specific data restrictions will be provisioned in the PE.
Protected Environment FAQ
As mentioned above, the new PE allows for growth of the HPC cluster as well as both the project and archive storage in a condominium style, similar to that in the general environment.
For the cost of adding an owner node to Redwood, please contact chpc at email@example.com.
For the cost of purchasing additional project space(each project is given, at no cost, 250GB) or archive space, see the PE storage page.
With the new VM farm, PE VMs will no longer be free. See the VM page for current pricing.
The use of allocations started July 1, 2018.
Unlike apexarch which was run unallocated, there will be an allocation process for time on redwood general resources. As in the general environemnt, there are two kinds of allocation:
- Quick allocation request -- 1 quarter only, 20,000 wallclock core hours
- Norrmal Allocation request -- submitted at most quarterly for up to 4 quarters at a time
Quick allocations are for PIs who are new to having a CHPC allocation, and can be submitted at any time. The awarded time is for the remainder of the current quarter. It is expected that after gaining experience using our systems with the quick allocation, the allocation process (below) will be followed. Quick allocations are reviewed by senior CHPC staff and awarded at CHPC's discretion.
Normal allocation requests are accepted 4 times per year, according to the following schedule
- December 1st for allocation beginning January 1st
- March 1st for allocations beginning April 1st
- June 1st for allocations beginning July 1st
- September 1st for allocations beginning October 1st
As in our general environment, users in groups without allocation can run in the freecycle mode on general nodes or as guest on the owner nodes, subject to preemption by jobs with allocation or owner jobs, respectively. Priority for allocation will be given to NIH funded research for the duration of the NIH Shared Instrumentation Grant (until Spring 2022). Allocations will be reviewed and awards made by the Protected Environment Policy Allocation Committee.
As in the general environment, a group may request up to four quarters at a time such that they only need to complete this process once per year. However, should needs change, groups can re-apply at any of the quarterly request windows even if they have an existing award.
There is one request allowed per research group – if your group has multiple projects, please be sure to select all projects that will make use of redwood in the request. Requests can be made by the PI of the project or his/her delegate, provided the delegate also has a PE account. If you have the ability to complete this form, when you log into the chpc website, www.chpc.utah.edu, there will be a section under “User Roles” for “PI/Delegate in the PE”.
- Step 1: Determining if your project fits in REDCAP or the University's instance of Box
- Step 2: Needs Assessment for CHPC, Risk assessment by governance risk & compliance office, Information sharing assessment form (ISAF) via privacy office.
- Step 3: Requesting access to a PE resource
- Step 4: Logging into the PE
Step 1: Determining if your project fits in REDCAP or Box
REDCAP: It may be that your project needs can be served by using the REDCAP (Research Electronic Data Capture) tool. REDCAP can be used to create web accessible forms, a secure database with continuous auditing, and a flexible reporting system. More information can be found at https://redcap01.brisc.utah.edu/ccts/redcap/index.php?action=training. To determine if the REDCAP tool fits with your project, require assistance or have any questions about REDCap, please contact REDCap Support or see Service Now - Survey Tools for more information.
Box: One can put PHI on the University instance of Box, http://box.utah.edu. The reference for the acceptable use of Box for PHI can be found at University of Utah Box User Agreement.pdf. Please refer to and see the section at the bottom about storage of regulated information. To use
the Box instance for PHI, users need to create a specific University Box account.
Personal accounts cannot be used. The UofU Box service doesn't fit the needs for all
use cases; if you only need a storage space under the box amount (see https://box.utah.edu/) for current limit) , then it may be a good fit. If the needs are to store and process
(HTC/HPC/SQL etc) or use SAS/SPSS and other applications, the needs are likely better
served via CHPC’s Protected Environment (PE).
If the data is de-identified, there are no regulatory restrictions or mandates to use the Protected Environment. For more information on what information is protected, please see http://www.hhs.gov/ocr/privacy/hipaa/understanding/summary/index.html.
For NEW projects, please submit the NEEDS ASSESSMENT FORM with all required information. We will respond to your request as soon as possible. In the meantime, please feel free to CONTACT US with any questions. If you already submitted needs assessment form, please click here to see status. NOTE: If you don't have a uNID, please see https://www.chpc.utah.edu/documentation/policies/1.2AccountPolicies.php
Depending upon the scope of the project, an "Inherent Risk survey" may need to be done by the Information Security Office (ISO), CHPC can help you with this - for more information and contact info please refer to https://it.utah.edu/node4/news/september_2017/colleagues.php email: ISO-GRC@utah.edu. A risk assessment and mitigation plan must be approved by ISPO Information Security Office.
If there is any information sharing with third parties, an information sharing assessment for (ISAF) needs to be initiated with the UofU privacy office to determin if a Business Associates Agreement needs to be on file. Please send CHPC your BAA or any contracts with 3rd parteis if you have on already, otherwise The ISAF must be completely filled out (Typed) by the requesting department and returned for evaluation to determine the need for a Business Associate Agreement or other agreement to protect the information being shared. ISAF form can be found at Business Associates. Please refer to the UofU Information Security and Privacy Office for details and help (and keep CHPC informed) .
'GENERAL' CHPC ACCOUNT . THEN YOU CAN GET A 'PROTECTED' CHPC ACCOUNT. IF YOU ENCOUNTER ANY PROBLEMS DON'T HESITATE TO CONTACT US BY SENDING AN EMAIL TO HELPDESK@CHPC.UTAH.EDUPLEASE BE SURE TO READ AND FOLLOW ALL STEPS IN THIS SECTION. YOU MUST FIRST HAVE A
- Please complete the UofU HIPAA security training and provide CHPC with a current training certificate. Depending on your University affiliation status (e.g., Health Science Center or Campus or ) this can be accomplished one of the following ways:
- For Campus affiliated unids:
- Login to https://cis.utah.edu
- Click on the "LMS BRIDGE" app/tile.
- Explore library “see all” categories.
- Safety & Compliance – HIPAA security.
- Click enroll & register & enter course. IF the cis.utah.edu enrollment instructions do not work for your uNID please try this direct URL https://utah.bridgeapp.com/learner/courses/978a9613/enroll
- For HSC affiliated unids: (this may be named "HIPAA Annual Compliance Training"
- Login to https://cis.utah.edu
- Click on the "Learning Mangement Systems" app/tile
- Login to https://cis.utah.edu
- For Students, Affiliates, Vendors or business partners (or others as needed if above
methods don't work):
- follow instructions for "Business Partners HIPAA Training" section via the bottom
of this web page.
- If you are not a UofU employee, faculty or staff the UofU privacy office also requires the following form to be on file. This form can be found via https://www.chpc.utah.edu/resources/Non-Employee%20Confidentiality%20and%20Security%20Agreement.pdf please email this to 2019_HI.firstname.lastname@example.org
- follow instructions for "Business Partners HIPAA Training" section via the bottom of this web page.
- Provide the HIPAA security training certificate proof of completion:
- Providing proof of hipaa training security completion for LMS bridge users can be found via: https://utah.bridgeapp.com/learner/courses/500/certificate or all LMS bridge learning via:
- Print/save completed cert to pdf (preferably name the file as your unid, u0000000.pdf).
- Email the HIPAA completion as an attachment to 2019_HI.email@example.com.
note; If you don't have the pdf print option feel free to save it in any format that works for you.
Acquire an account for the CHPC protected environment OR associate your existing PE account with a new project:
NOTE: The project PI must have an account provisioned in the protected environment before any project user accounts can be created.
a) If you do not have an existing CHPC account, then you need to apply for a general CHPC account first via the following URL: (if you already have a CHPC general account go to 2b) https://www.chpc.utah.edu/apps/profile/account_request.php
NOTE: If you don't have a uNID, please see https://www.chpc.utah.edu/documentation/policies/1.2AccountPolicies.php
b) If you have an existing CHPC general account and need access to the CHPC PE (protected environment) then you also need to request a Protected Environment/HIPAA CHPC account https://www.chpc.utah.edu/role/user/requestPE.php NOTE: You'll need to reference your project #, ask your PI if you don't know it.
c) If you have an existing CHPC PE account, but need your account associated with an additional project (or projects), you will need to go to the same form, where you will see a note about already having an account and a new link for adding an additional project.
Get a DUO security account: This is an additional authentication step for additional security. If you don't have a DUO security account setup already then you'll need to do the following:
a) If you don't already use DUO security, you will need to go to the following URL and register your device. Visit: https://ese.idm.utah.edu/duo-management to add your device to the campus DUO two factor authentication service.
b) Then notify CHPC that you've completed the DUO registration - then we will request UIT to affiliate your DUO account to the proper CHPC PE group(s) and we will notify you when it's complete. see CHPC's DUO software page for more information.
Once you've completed the previous steps (and have been notified by CHPC that your CHPC PE account is provisioned) AND the PE resources needs (narwhal, redwood, an existing protected environment virtual machine (VM), default project directories, etc) for the project exist, you can go to step 4 for instructions of how to access the CHPC PE.
If the project requires a new VM provisioned (one of the items requested via the Needs Assessment), you will be notified when the VM has been provisioned. If you have not yet discussed the VM requirements with CHPC, we will reach out to schedule a call or meeting with you. Any new protected environment virtual machine requests must come from the PI (or co PI). See 1.4.2 Virtual Machine Allocation Policy For VM "block" sizes and cost please refer to: https://www.chpc.utah.edu/resources/virtualmachines.php#pvf
In addiition, if the new project needs additional storage, you can submit a ticket to purchase additional project space on mamoth. See the PE storage page for details of the cost structure of storage.
Preface: Access to the CHPC PE is allowed from UofU IP networks only, if you're coming from a non UofU network IP address you will need to connect to the UofU VPN pool first. (instructions for connecting from Windows can be found at How to connect to vpn for CHPC resources and instructions for connecting from Mac can be found at Mac instructions for using the VPN).
Using an SSH client: This is the easiest one to test before attempting to use the fastx or rdp methods below (if SSH doesn't work don't bother trying the fastx or rdp methods - contact us for help) NOTE: We have verified linux openssh client and windows putty ssh client.
- SSH to redwood.chpc.utah.edu (this does a DNS round robin to redwood1.chpc.utah.edu
& redwood2.chpc.utah.edu), using your campus uNID. You may want to use 'ssh -Y uNID@redwood.chpc.utah.edu' so any xwindow apps will work
(or if using windows/mac make sure to config your ssh client session to enable X11 forwarding).
- Enter your campus uNID and password then after a successful 1st authentication you'll
select one of the three options that DUO two-factor presents you (for example select #1 for DUO push) then accept & confirm from your phone and you should have successfully logged in.
If you're not familiar with SSH - here is a link with more info.
Please see the following link for host roles: Protected Environment (CHPC-PE) service host roles and access
- SSH to redwood.chpc.utah.edu (this does a DNS round robin to redwood1.chpc.utah.edu & redwood2.chpc.utah.edu), using your campus uNID. You may want to use 'ssh -Y uNID@redwood.chpc.utah.edu' so any xwindow apps will work (or if using windows/mac make sure to config your ssh client session to enable X11 forwarding).
Using FastX to get to redwood1.chpc.utah.edu (or other linux hosts as needed)
FastX 2.x Instructions: Please see fastx2 documentation using host name you want to reach (e.g., redwood1 or redwood2 e.g, https://redwood.chpc.utah.edu:3443 unless you have another designated owner node).
NOTE: Make sure your coming from a valid UofU network, see Step 4 preface above.
Using remote desktop (aka RDP) to get to the windows host narwhal.chpc.uah.edu:
- Use a remote desktop client on your platform to open a session to narwhal.chpc.utah.edu (use ad\uNID for the username), It may present you with a certificate if so click "yes" to accept.
- The DUO client on your phone should notify you for approval and confirm the authentication of your device.
- The RDP client will then prompt you for your username and password login information.
- See this link for detailed instructions on connecting from Windows or a Mac - useful for sending users to this link
- If all the above steps are accounted for the issue connecting might be with the RDP version of client (seems to happen with Windows 7 Home version) - have them upgrade the RDP client.
e.g. either using an SSH or the FastX client to Linux OR using remote desktop to RDP to windows. In all cases you should be two-factor prompted via the DUO client on your phone to allow the login.
If there are problems or questions please open a ticket with firstname.lastname@example.org
How to access your protected environments home directory & project group directories from UNIX hosts redwood1.chpc.utah.edu or redwood2.chpc.utah.edu
For IRB project access, the full/absolute path to IRB project data is
/uufs/chpc.utah.edu/common/PE/<name of project directory>
Or from your homedir you can do... (it's not all tab complete able, because it's automounted)
cd ../IRB_XXXX (or whatever your project dir is named)
Please see the Protected Environment FAQ for more information about what resources are available in the CHPC protected environment.
If this is a new project you'll need to work with CHPC and the Information Security and Privacy office (ISPO) (http://privacy.utah.edu/) to satisfy security requirements:
- Depending upon the scope of the project, an "Inherent Risk survey" may need to be done by the Information Security Office (ISO). A risk assessment and mitigation plan must be approved by ISPO Information Security OfficeA satisfactory scan report must be completed.
- If there is any information sharing with third parties, an information sharing assessment form (ISAF) needs to be initiated with the UofU privacy office to determine if a Business Associates Agreement needs to be on file. Please send CHPC your BAA if you have one already, otherwise The ISAF must be completely filled out (Typed) by the requesting department and returned for evaluation to determine the need for a Business Associate Agreement or other agreement to protect the information being shared. ISAF form can be found at Business Associates. Please refer to the UofU Information Security and Privacy Office for details and help (and keep CHPC informed) .