Office of Research Computing

Spring Break – Planned Maintenance Schedule

The ORC will perform maintenance activities over the Spring Break week March 13th through March 17th. These activities will cause disruption to normal ORC services . Virtual Machine systems and storage servers and services may be unavailable for periods during the week.

The HOPPER and ARGO clusters will be down from 6 AM on 03/13/2023 through 6 AM on 03/15/2023. A maintenance reservation has been created on all nodes. Jobs submitted between now and the start of the maintenance must be submitted with time limits such that they will complete before the start of the maintenance window, otherwise they will be held until after 6am on 03/15/2023.

For the same reason, there will be no New User tutorial for Tuesday 03/14/2023. The tutorials will resume on Thursday 3/16/2023.

Virginia Women in HPC (VA-WHPC ): Women in HPC & IT Leadership Roles, Part II

What:

Let’s welcome 2023 with a community event to hear from female leaders in the IT & HPC field sharing challenges and successes experienced throughout their careers. Don’t miss this fantastic opportunity to learn about career strategies and contribute to our discussion of how the playing field may be leveled to offer equitable IT & HPC leadership opportunities for women and minorities. Attendees are invited to share their own experiences and engage with panelists during this interactive Q&A session.

Time:

January 31st, 2023 at 1:00 pm – 2:00 pm EST

Featured Panelists

Virginia Evans– Former Vice President and Chief Information Officer (CIO) at the University of Virginia

Shannon Phillips – Director of IT Service Operations for University Libraries at Virginia Tech

 Moderator – Karsten Siller – Director of User Services, Research Computing at University of Virginia

REGISTER NOW!

Speaker’s bio

  • Virginia Evans – Former Vice President and Chief Information Officer (CIO) at the University of Virginia 

Virginia Evans is the former vice president and chief information officer (CIO) at the University of Virginia, where she was responsible for planning and delivering central IT infrastructure, applications, IT support, and information security and IT policy, as well as research computing for the University.

Ms. Evans has over 35 years of IT experience, ranging from IT consulting with Andersen Consulting (now Accenture) and independent IT consulting, to 30 years managing IT at the University of Virginia at both the central and school levels.  She is an active participant in national IT organizations of large research universities—CSG (Common Solutions Group) and RUCC (Research University CIO group), as well as Internet2.

Ms. Evans holds a B.S. degree with a concentration in Accounting from the University of North Carolina at Chapel Hill and an M.S. degree in Management Information Systems from the University of Virginia’s McIntire School of Commerce, where she has also served as an adjunct professor, teaching classes at the graduate level.

  • Shannon Phillips – Director of IT Service Operations for University Libraries at Virginia Tech 

Shannon Phillips is the Director of IT Service Operations for University Libraries at Virginia Tech. In her current position, she is responsible for leading the IT professionals who provide support desk services, desktop support, systems support, technology training, and IT policy compliance across all University Libraries locations.

Shannon is an IT professional with more than twenty years experience working for several public universities across the Commonwealth of Virginia.  Past positions held include Director of Technology Support Services, Director of Instructional Technologies, and Associate Director for Academic Computing. Shannon holds a BA in Music as well as an MAEd from Virginia Tech. Her graduate studies were focused in instructional design and instructional technology.

This virtual event is jointly hosted by Virginia Commonwealth University, George Mason University, Virginia Tech, William & Mary, University of Richmond, Virginia Institute of Marine Science, and the University of Virginia.  Please check our website: https://va-whpc.org

Attached you will find the event flyer (PDF) if you would like to share it with others.

P.S. The VA Women in High Performance Computing program is holding a logo competition!  

VA-WHPC will soon be applying to become an official chapter of the international WHPC organization, and we would love to have a logo for our chapter that was designed by one of our community members. There will be a cash prize of $500 given to the selected logo (contributed by Cambridge Computer Services).

Winter Break Support – important information.

Please be advised that George Mason University will be closed for Winter Break  

Monday, December 19, 2022 – Monday, January 2, 2023.   

During the break, the ORC resources such as the Hopper cluster are expected to be up and functioning as normal. ORC will respond to urgent catastrophic events, however, routine questions or tickets filed at [email protected] may not receive a response until after the break. Weekly regular activities such as the ORC New User tutorials will be suspended until university offices reopen on Tuesday, January 3, 2023. 

Please continue to check the ORC Website for more updates and other upcoming events. 

The ORC wishes you a safe and happy holiday season.

Delayed Responses During Thanksgiving Week, 11/21/2022 – 11/27/2022

Due to the upcoming Thanksgiving break, please expect delayed responses to emails and tickets between 11/21/2022 and 11/27/2022. In addition, there will be no New User Tutorial for this coming Thursday, 11/24/2022.

Please send any questions to [email protected]

[SC22] SuperComputing 2022

[SC22] The International Conference for High Performance Computing, Networking, Storage, and Analysis 

The ORC will be at the SC22 Conference between November 13–18, 2022. While the ORC clusters are expected to be up and running as always, researchers using the cluster are advised that any tickets/questions filed in the week of the conference will likely have a delayed response.

Regular Tutorials Suspended for Tuesday, 11/15/2022 

For the conference week, our regularly held user tutorials on Tuesdays and Thursdays for those that have recently requested new cluster accounts will be held  only on Thursday, 11/17/2022

Releasing New Nodes on Hopper

We are happy to announce that starting Sep 07, 2022, the new AMD CPU and GPU nodes which were being beta-tested will be put into production on Hopper. These nodes will be integrated into the existing partitions on Hopper. The main points to note about the nodes are: 

  • All the new nodes have AMD CPUs with 64 or 128 cores each  
  • The new GPU nodes all have 4 NVIDIA A100 80GB GPUs and 64 CPU cores with 512GB of RAM.

The new nodes will also include a few high memory nodes (1TB/2TB/4TB) that will be accessible from a new, ‘bigmem’ partition for memory-intensive calculations. The table below summarizes the updated partitions. More details can be found on our Resources Page

Summary of SLURM partition updates

Updated Partitions Current Partitions 
normal normal, amd-test 
contrib contrib 
contrib-gpu gpu-test 
gpuq gpuq, gpu-test 
bigmem amd-test 

 New SLURM Partition Details

PARTITIONTIMELIMIT[Days-Hours:Mins:Secs]NODESNODELIST
debug0-01:00:003hop[043-045]
interactive0-12:00:003hop[043-045]
contrib7-00:00:0042hop[001-042]
normal*7-00:00:0096hop[046-073],amd[001-068]
bigmem7-00:00:0022amd[069-090]
gpuq5-00:00:0015dgx[001-002],gpu[012-024]
contrib-gpu5-00:00:0011gpu[001-010]

Beta testers who have been using the ‘amd-test’ and ‘gpu-test’ partitions are advised to change their scripts to the updated partitions as the *-test partitions will no longer be usable starting Sep 12, 2022. 

AMD Head Nodes/Login Nodes

You can now access two additional head-nodes on Hopper, each of which has dual AMD CPUs and a GPU card.  This will allow for the testing as well as compilation GPU codes directly on the head nodes.  

Access to the cluster through ssh will work as normal. With the new additions, it will now be possible to ssh directly into either the AMD login nodes or the Intel login nodes.

Summary of available Login/Head-nodes on Hopper

Name  CPUS GPU Memory 
hopper-intel 48 Intel 384 GB RAM 
hopper-amd 64 AMD  1 NVIDIA T4 256 GB RAM 

To access the Intel head nodes hopper1/hopper2 directly, use

To access the AMD head nodes, hop-amd-1/hop-amd-2 directly, use

Correctly Running Distributed Jobs

Since all these nodes will be added to the existing partitions, going forward it will be important to use the constraints below for distributed multi-node jobs so that they run on the same architecture 

  • #SBATCH –constraint=amd for running on the AMD nodes 
  • #SBATCH –constraint=intel for running on the Intel nodes 

Using the Correct Software Stack with the New Nodes

It is also important to make sure that you’re using the new software stack that has been built to run across the different nodes regardless of architecture. To do this, you would need to use the gnu10 and openmpi/4.1.2 compiled software by first loading the necessary modules with

  • module load gnu10
  • module load <package-name>

This will switch out the modules available with those that are newly built and have been tested to run on the AMD nodes.

VA-WHPC upcoming meeting

VA-WHPC members, 

Inspiring Diversity and Inclusion Panel session is almost here, you don’t have to miss it.

Please register to join us!

Virginia Women in HPC (VA-WHPC) – Inspiring Diversity and Inclusion

Topic: 

Empowering and expanding the role of women and minorities in HPC

What:

Join our panel of research computing professionals to discuss ways to increase inclusive excellence in HPC! This quarter’s panel discussion will touch upon challenges to being a woman or minority in the field of HPC, how those challenges can be addressed, lessons learned, HPC early career perspectives, as well as means to improving diversity and inclusion in the workplace.  Attendees are invited to share their own experiences and engage with panelists during this interactive Q&A session.

Time: 

 August 10, 2022 01:00 PM EST

Featured Panelist:

  • Jackie Milhans – Associate Director, Research Computing Services, Northwestern University
  • Lara Timm – HPC Engineer, Center for High Performance Computing, Council for Scientific and Industrial Research (CSIR)
  • Rachel Spraker – Senior Director for Equity and Inclusive Excellence, Division for Diversity, Equity, and Inclusion, University of Virginia
  • Moderator – Eric Walter, William & Mary

Register Now!

Speaker’s bio

  • Jackie Milhans, Ph.D. Associate Director, Research Computing Services at Northwestern University
    Website Link: https://www.linkedin.com/in/milhans/
    Jackie is the Associate Director of Northwestern Research Computing Services. In this role, she is responsible for building relationships with and gathering research support requirements from deans, faculty, and University leadership. She leads the development of new services to address emerging technology and compliance requirements in the diverse breadth of research domains at Northwestern. She is responsible for the long-term strategic planning for research support and delivering a portfolio of computational, data science, data management, cloud, and visualization support services for faculty, student, and staff researchers.
    Jackie serves on a number of committees and working groups, including recently serving as Co-Lead for the EDUCAUSE Research Computing and Data Community Group, Co-Founder and Co-Chair of the Northwestern IT Diversity, Equity, and Inclusion Steering committee, and Co-Chair for the PEARC21 Program Committee.
    She has a passion for learning and sharing methods to build and lead effective, engaged, and diverse teams through improved hiring and management practices, as well as ensuring an equitable and inclusive workplace. She has presented at various conferences over the past several years on topics including diversity, equity, and inclusion; management; and research computing and data. She completed her PhD in Materials Science and Engineering at the Georgia Institute of Technology and her BS in Materials Science and Engineering at Carnegie Mellon University. She completed her Postdoc at Los Alamos National Laboratory.
  • Lara Timm: HPC Engineer at Advanced Computer Engineering (ACE) Lab, Centre for High Performance Computing (CHPC), Council for Scientific and Industrial Research (CSIR), South Africa
    Talk Title: Finding your fit in HPC: An early career perspective
  • Website Link: https://www.linkedin.com/in/lara-timm-59618b14a/
  • With a background in biomedical and electrical engineering, Lara is new to the field of HPC. She started her HPC journey in a graduate role at the Centre for High-Performance Computing (CHPC) in Cape Town, South Africa. She now holds the title HPC Engineer in the Advanced Computed Engineering Lab at the CHPC. Here, efforts are focused on pursuing research avenues in HPC as well as HCD activities, collaboration, and outreach. Lara is passionate about sharing her experiences, in HPC and otherwise, with a special interest in cloud technologies, infrastructure as code, HCD and outreach. Lara has a keen interest in the WHPC community – she was an early career presenter at the WHPC workshop at ISC22.
  • Rachel Spraker: Senior Director for Equity and Inclusive Excellence at the University of  Virginia

Talk Title: Advancing Equity and Inclusion in the Workplace
Website Link: https://dei.virginia.edu/people/rachel-spraker
Rachel Spraker (she/they) is the Senior Director for Equity and Inclusive Excellence with the Division for Diversity, Equity, and Inclusion. Rachel serves UVA in the Office for Diversity, Equity, and Inclusion as well as the Office for Equal Opportunity and Civil Rights. Rachel develops, implements, and evaluates policies, practices, and programs which seek to advance the representational diversity, inclusive capacity, and sense of belonging of the University’s workforce and learning community. Rachel has previously served on the executive board of the American Association for Access, Equity, and Diversity and as an equity consultant for institutions of higher education.  Rachel holds a Master of Science in Sociology from Virginia Commonwealth University with work focused on landscapes of racial violence and is currently a part-time doctoral student at UVA in the School of Education and Human Development.

This virtual event is jointly hosted by Virginia Commonwealth University, George Mason University, Virginia Tech, William & Mary, University of Richmond, and Research Computing at the University of Virginia. Please check our website: https://va-whpc.org/

Attached you will find the event flyer (PDF) if you would like to share it with others.

Regards, 

Gladys K. Andino, PhD 

Senior Computational Scientist

Founder and Chair of  VA-WHPC 

University of Virginia (UVA)
Research Computing

[email protected]

VA Women in HPC (VA-WHPC) new website

VA WHPC have launched a new website at https://va-whpc.org/

The next session by WHPC is a panel on “Empowering and expanding the role of women and  minorities in HPC”, scheduled for 08/10/2022 at 1:00PM EST.  Registration details to follow.

You can also refer to the new VA Women in HPC website for this and more updates on their events.

 

Annual Practice & Experience in Advanced Research Computing (PEARC) conference, 07/10/2022 – 07/15/2022

Annual Practice & Experience in Advanced Research Computing (PEARC) conference, 2022

The ORC will be at the PEARC22 Conference in Boston, MA between 07/10/2022 and 07/15/2022. While the ORC clusters are expected to be up and running as always, researchers using the cluster are advised that any tickets/questions filed in the week of the conference will likely have a delayed response.

Regular Tutorials Suspended for the PEARC22 Conference Week

At the same time, the regularly held user tutorials on Tuesdays and Thursdays for  those that have recently requested new cluster accounts will be suspended to be resumed on the week of 7/18/2022.

 

 

 

ORC Director Jayshree Sarma to Speak at VIRGINIA WOMEN IN HPC – SUPERCOMPUTING FOR EVERYONE on April 27th, 2022 1:00 pm – 2:00 pm

Virginia Women in HPC

Supercomputing For Everyone

When

April 27th, 2022
1:00 pm – 2:00 pm

Topic: The High-Performance Computing landscape at VA-WHPC member institutions.

What

Our panel of research computing professionals will describe available infrastructure and support resources with an overview of their home institutions’ HPC user base.  Challenges and learning curves involved in using HPC effectively will also be discussed.  Attendees are invited to share their own experiences and engage with panelists during this interactive Q&A session.

Featured Panelists

  • Matt Brown – Virginia Tech
  • Jayshree Sarma – George Mason University
  • Carol Parish – University of Richmond
  • Eric Walter – William & Mary
  • Mike Davis – Virginia Commonwealth University
  • Jacalyn Huband – University of Virginia

Moderator – Gladys Andino, University of Virginia

Register Now!

 

This virtual event is jointly hosted by Virginia Commonwealth University, George Mason University, Virginia Tech, William & Mary, University of Richmond, and Research Computing at the University of Virginia.

VA-WHPC-event flyer