slideshow 3


Slides for Minerva Town Hall meeting
The slides for Minerva Town Hall meeting are available on our website: (MUG Meeting Nov 29, 2018).

Highlights from the meeting:

  • Minerva usage status and our accomplishments in 2018
  • Main upgrade plans for 2019:
    • New compute partition Chimera: specs and installation plan
    • Storage upgrade: GPFS upgrade to 5.x and new filesystem /sc/hydra
    • OS upgrade, package rebuild and new module system
    • Queue structure changes
    • Container support

New compute partition: Chimera
We are happy to announce that we purchased a new compute partition Chimera. It will be available to users in early 2019. Specs of the new compute partition:

4x login nodes - Intel 8168 24C, 2.7GHz - 384 GB memory
280+ compute nodes - Intel 8168 24C, 2.7GHz - 192 GB memory
4x high memory nodes - Intel 8168 24C, 2.7GHz - 1.5 TB memory
48 V100 GPUs in 12 nodes - Intel 6142 16C, 2.6GHz - 384 GB memory - 4x V100-16 GB GPU
10x gateway nodes

New NFS storage (for users home directories) - 192 TB raw / 160 TB usable RAID6

Mellanox EDR Infiniband fat tree fabric (100Gb/s)

Total system memory (computes + GPU + high mem) = 65.7 TB
Total number of cores (computes + GPU + high mem) = 14,304 cores
Peak performance (computes + GPU + high mem, CPU only) = 1.2 PFlops/s

We will send out necessary announcement during the integration and make this transition seamless for all users.

Retire 2,300 Mothra cores and K20 GPU nodes: Dec 17, 2018
On Dec 17, 2018, we will shut down 3 racks of Mothra nodes, which include 2,300 cores and the all K20 GPU nodes. This is necessary to make space in the data center for the new compute partition.

New module system and packages are available on test-centos7 queue
We are currently rebuilding new packages on Centos 7 with up-to-date compilers in conjunction with OS upgrade and Chimera integration. Currently, 158 packages are available and the rest of ~2000 packages may be compatible with Centos 7. We would like you to test your jobs in the new environment. Please let us know for the failed packages.

Singularity is available on test-centos7 queue
Singularity is currently available on test-centos7 queue and will be provided in Chimera compute partition in 2019. If you would like to get a shell with orga mounted in the image, use command “$ singularity shell -B /sc/orga hello.simg”.

Manda, Mothra compute partition out of warranty from Jan 1, 2019
From Jan 1, 2019, the Manda and Mothra compute partition will be out of warranty. We will continue to run these servers with the best effort of support.

We do not backup user data. It is the users' responsibility to ensure data is backed up in accordance with their funding agency or private organization requirements. Refer to "Preserving Data: Who’s Got Your Back(up)?" for helpful hints in developing your individual backup strategy.

All Announcements/Reminders.

Theme by Danetsoft and Danang Probo Sayekti inspired by Maksimer