Job monitoring system

When submitting jobs to the batch system, users need to specify how many CPUs, GPUs and how much RAM their job requires.

But requesting those resources does not necessarily mean that the job actually uses those resources. Users have commonly asked the Spartan admins to help them monitor the resources usage of their jobs. We have developed a system that helps the users monitor their running jobs.

This is in addition to the simple aggregate summary that can be invoked if the email options are included in a job submission script. i.e,

# Specify your email address to be notified of progress.
# Includes job usage statistics
#SBATCH --mail-user=myemail@example.edu.au
#SBATCH --mail-type=ALL

CLI based monitoring

You can monitor your jobs using a CLI-based tool called my-job-stats. How to use it, and what it can do, can be found here

Web/graphical based monitoring

You can monitor your jobs using your web browser. This allows you to get a history of the usage of your job. How to use it, and what it can do, can be found here

Realtime monitoring

You can also connect to the server your job is running on and monitor your job that way. How to use it, and what it can do, can be found here