Video Tutorials

ARC provides a number of video tutorials on our channel on video.vt.edu. In particular, the following sequence walks a user through the fundamentals of ARC usage in less than an hour:

Login

How to access ARC clusters for the first time (and streamlining access for subsequent logins):

Accessing Software

The following videos will walk the user through accessing software that ARC has installed or through setting up your own packages:

Note that these videos require a VT Login to access. Also, each video has a table of contents that can be used to skip between sections; this can be accessed by clicking the “hamburger” (three horizontal bars) button at the top left of the video.

We are actively updating this page.

There are many types of videos linked on this page. Generally, they fall into two classes:

  1. General overviews.

  2. Narrow focus on how to accomplish one thing.

With respect to bullet #2, sometimes, one video suffices for a topic. In other cases, multiple videos are required. An example of the latter are virtual environments (VEs). There are videos on why they are needed, how to use modules (in setting up general environments), how to build and use VEs of various types, and how to use VEs across programming languages. Rather than throw all of these topics into one (longer) video, we carve the issues up into several videos so one can more directly satisfy their needs. You might, for example, only want to know how to build a VE and use it in a Jupyter notebook.

We try to make very few assumptions about the experience of the user so that videos are of value to novices and those with experience. All users of all types are welcome on ARC resources and are encouraged to use them.

General Overview

These videos provides a general overview of use of ARC systems.

Connecting to ARC Clusters

There are multiple ways to connect to ARC clusters.

  • How to access ARC clusters using a terminal window on your laptop and ssh (and streamlining access for subsequent logins). This approaches uses the command line for working on clusters.

  • How to connect to ARC clusters using VS Code. This approach uses an IDE for working on clusters.

  • How to access ARC clusters using Open OnDemand (OOD). This approach uses an assortment of ways for working on clusters (e.g., command line, UIs).

How to Run Codes—Your Own or Commercial/Open Software

Whether you run your own code, e.g., built using some programming language, or a commercial/open source code such as Ansys, you will be interacting with the scheduler. Our scheduler on ARC clusters is the Slurm Scheduler. The first video is an excellent and concise introduction for running interactive and batch jobs. The subsequent videos are motivated by cluster configurations that increase throughput of jobs on the clusters and signficantly reduce wait time. To specify more precisely job resources, concepts such as constraints are needed that are not covered in the first video.

  • How to run both interactive and batch jobs.

  • Learn the different types of compute nodes on clusters and how to specify them for your jobs. Watch this before the later videos of this section.

  • A more detaile example of an interactive job that uses the material in the second video—that is, how to use constraints to specify compute node types.

  • A more detaile example of a batch job that uses the material in the second video—that is, how to use constraints to specify compute node types.

Self-Monitoring Your Activities and Understanding How Your Code Is Performing

ARC clusters are communal resources. They work best when everyone knows the purposes for different types of computer nodes (i.e., computers) on a cluster. These videos describe appropriate (and inappropriate) uses, and just as importantly, how to monitor your own use of the computing resources. And monitoring your (computational) jobs can give you insights about your codes and their performance.

File Compression and Archiving

File compression and file archiving are two separate activities. However, they can also be used in combination. These videos describe how to compress and archive files.

File Transfer: Transferring files onto and off of clusters

One can use these tools to transfer files between and within machines/computers; here, our focus is ARC clusters.

Different Drives on ARC Clusters

This video describes the various mounts/directories for doing different types of work. For example, these drives vary in the desired longevity of files contained in them.

Drives for Use on Clusters

Environments

Environments are collections of software that tailor an otherwise “basic” computing ecosystem into one that supports your particular computing needs for a particular type of task. You may need different environments for your different tasks. There is a series of videos here on

  1. motivation,

  2. how to use modules,

  3. how to structure directories to house your virtual environments,

  4. how to construct and use virtual environments (VEs) for

    • command-line execution of code and

    • use with applications like Jupyter notebooks.

Running Jobs on ARC Clusters

The two dominant ways to run jobs on ARC clusters are:

  • interactive jobs

  • batch jobs.

Interactive Jobs

This video provides an example of an interactive job.

Batch Jobs

This video provides an example of a batch job.