Support

Support Options

Submit a Support Ticket

 
You are here: Home » Tools & Resources » Tools » High Volume Batch Submission Environment » About

High Volume Batch Submission Environment

By Gregory P Rodgers

Purdue University

A set of utilities for consistent data management of batch job submission for multiple venues

Version 1.0-72 - published on 03 Feb 2012

Open source: license | download

View All Supporting Documents

Category Tools
Abstract

usage: batchsubmit [ batchsubmit options ] application_command [application command arguments ]

batchsubmit options that require a value:
--venue local,osg,steele,ranger,kraken. Default is local .
--jobtype anything_with_no_spaces. Default is lowercase of application_command .
--infilearg Which application command argument is the primary input file.
For example, 1 indicates the first argument after appilcation_command is input file.
Typically, this is 1 for most applications. However, default is no input file.
--infile Input file, ignored if --infilearg is specified
Not typically used because input file typically FOLLOWS the application_command.
--appdir Directory containing the application with bin and lib subdirectories.
The executable command must be in appdir/bin subdirectory.
Both bin and lib directories are sent to execution machine for every run.
Be careful not to specify a large installed application directory.
--xdqueue Queue for xsede machines (steele, ranger, and kraken). Default is "standby".
--cmdfile Alternate cmdfile, This only used for testing changes to cmdfile.
cmdfile is the generic application wrapper that is remotely executed.
--ncpus number of processors
--ppn number of processors per node
This must be a factor of ncpus.
--envars List of environment variables to commute separated by commas.
Only need the names here, values must be set before calling batchsubmit
For local execution, all environment variables are commuted.

batchsubmit options with no value:
--wait Wait for job to finish before returning from command.
--onlyinfile Only copy infile, otherwise copy all files in same directory
Default is to copy all files in same directory as infile.
--rcopyindir Recursively copy input file directory, not just files in same dir.
This option not permitted if inputfile is in HOME directory.
--nonotitfy Do not send email when job completes.
--nonoitfiy is automatic when --wait is specified.
-h Print this message
--help Print this message

Example usage:
batchsubmit date
batchsubmit --venue osg --infilearg 1 --wait --appdir /apps/openseesbuild/osg OpenSees sine_no_gui.tcl

Cite this work

Researchers should cite this work as follows:

  • Gregory P Rodgers (2012), "High Volume Batch Submission Environment," http://nees.org/resources/batchsubmit.

    BibTex | EndNote