Versions Compared

Old Version 3

changes.mady.by.user Donald Birnbaum

Saved on

compared with

New Version Current

changes.mady.by.user Matthew Mjelde

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This document details how to use the ECEN Olympus cluster to remotely access software used in the ECEN Zachry academic Linux labs and for research.

Table of Contents
maxLevel7
minLevel1

What is the Cluster

The Olympus cluster consists of the login node (olympus.ece.tamu.edu), six non-GPU compute nodes and three five GPU compute nodes.    The cluster has software that ensures users receive the resources needed for their labs by distributing users across the compute nodes based on their course requirements.

Table of Contents

...

. There is limited software installed on the Olympus head node.

  • Each of the six compute nodes have dual Xeon E5-2650 v3 CPU and 256GB RAM.

  • Three of the GPU nodes have dual Xeon Gold 6130 with 392GB RAM and four Nvidia V100 GPUs

  • Two of the GPU nodes have dual Xeon Gold 6326 with 256GB RAM and four Nvidia A100 GPUs

Cluster Usage Limitations

To assure resources are available to all students, the following limitations are enforced.

...

Non-GPU limitations:

  1. Undergraduate users (academic)

    1. are allowed two simultaneous interactive sessions on the non-GPU compute nodes. 

...

    1. Users can log in to Olympus using ssh with two different sessions and run the proper load-ecen-### command in each ssh session. 

    2. Each interactive session is limited to a maximum of 12 hours.

  2. Graduate Users (academic)

    1. are allowed to use up to eight cores on the non-GPU compute nodes.  Users can log in to Olympus using ssh with four different sessions and run the proper load-ecen-### command in each ssh session. 

    2. Each interactive session is limited to a maximum of 12 hours.

  3. Research Users

    1. are allowed to use up to 10 cores on the non-GPU compute nodes. 

    2. Each job is limited to a maximum of 48 hours

GPU Limitations

GPU nodes are available for faculty and students for approved instructional and research use. If you need GPU access please have your professor contact the Linux support team. 

  1. Undergraduate Users

    1. are limited to using 8 cpu cores and 1 gpu

  2. Graduate/ Research Users

    1. are limited to using a total of 32 cpu cores and 4 gpus

How to Use the Cluster

Requirements to Login to Olympus.

  1. You will need an ssh/xwindows client on your computer.

    1. On windows systems, install MobaXTerm personal edition. 

...

    2. Putty and XMing are also an option for Windows users.

    3. On Macintosh install the XQuartz software.  Detailed instructions for accessing Olympus from off campus can be found here:

Graphical Applications on the Olympus Cluster and ECEN Interactive Machines from Off-Campus

How go login to Olympus

  1. Open MobaXTerm on windows or the terminal program on Mac

  2. ssh to olympus.ece.tamu.edu, i.e.

...

  1. ssh -Y netid@olympus.ece.tamu.edu (replace netid with your NetID)

  2. Log in using your NetID password

...

  1. For non-gpu academic users, you will need to connect to an available compute node.  Enter the proper load-ecen-###command at the prompt and hit return. The command that you will run depends on which course you are taking. The following are valid commands:

    1. load-ecen-248

    2. load-ecen-350

    3. load-ecen-403

    4. load-ecen-425

    5. load-

...

    1. ecen-

...

    1. 449

    2. load-ecen-

...

    1. 454

    2. load-ecen-

...

    1. 468

    2. load-ecen-

...

    1. 474

    2. load-ecen-

...

    1. 475

    2. load-ecen-

...

    1. 620

    2. load-ecen-

...

    1. 625

    2. load-ecen-651

    3. load-ecen-655

    4. load-ecen-676

    5. load-ecen-680

    6. load-ecen-704

    7. load-ecen-714

    8. load-ecen-720

    9. load-ecen-749

  2. Source the same file that you use in the Zachry Linux Labs

...

  1. .

  2. For CPU research users the following interactive load commands are available.

    1. load-2core - creates a 2 core job on a cpu node

    2. load-4core - creates a 4 core job on a cpu node

  3. For GPU users see instructions below on setting up containers using Singularity. Singularity is similar to Docker and allow you to create custom environments for your gpu jobs. These environments include using different versions of Linux inside the container.

Instructions for Using Singularity Containers for GPU and specialty programs on Olympus

Singularity Containers on Olympus GPU Nodes

Once you have set up your environment and debugged your environment/programs in the interactive gpu session, you can submit a job to run in batch mode. 

How to start a non-interactive (batch)

These jobs run in the background on the cluster and do not require an active terminal session once submitted.  

The GPU queue has the following limitations:  

  1. Maximum of 8 CPU cores per job

  2. Maximum of 1 GPU per job

  3. Maximum of 1 Job running per user.  You can queue multiple jobs in the system.

  4. Maximum runtime of 36 hours per job

Jobs are submitted using a script file.  An example script file is located at:

...

/mnt/lab_files/ECEN403-404/submit-gpu.sh

This file has comment lines detailing what each command does.  Copy this file to your home directory and update it to match your virtual environment and program. Once this has been done, submit the script to the scheduler using the command: sbatch name_of_shell_file.sh. If you did not change the name of the script file, the command would be sbatch submit-gpu.sh. You can check the status of your job using the command qstat or squeue.

You can observe the progress of your job by checking the log files that are generated.  These files are updated as your program runs.

Instructions for Using Singularity Containers on Olympus

See Singularity Containers on Olympus GPU Nodes for instructions.