IDRIS Jean-Zay cluster JEAN-ZAY/std

IDRIS Jean-Zay cluster JEAN-ZAY/std#

Description#

This plugin deals with specific environment characteristics of the Jean-Zay supercomputer at IDRIS (France), more specifically the cpu_p1 partition used for scientific computing with MPI parallelization.

YAML arguments#

The following arguments are used to configure the plugin. pyCIF will return an exception at the initialization if mandatory arguments are not specified, or if any argument does not fit accepted values or type:

Optional arguments#

python : str, optional, default “python”

the python command used to run sub-instances of pyCIF

python_venv : str, optional

path to the python virtual environment to use

python_module : str, optional, default “python/3.11.5”

the python module to load

project : str, optional

project on which to submit job

partition : “cpu_p1” or “prepost” or “visu” or “archive” or “compil” or “compil_h100” or “v100” or “a100” or “h100”, optional

partition on which to submit job

gpu : bool, optional

Run the job on GPU

nodes : int, optional, default 1

number of nodes to use by the jobs launched by the CIF (analytic, EnKF modes)

cores : int, optional, default 1

number of cores to use by the jobs launched by the CIF (analytic, EnKF modes)

qos : “qos_cpu-t3” or “qos_cpu-t4” or “qos_cpu-dev” or “qos_gpu-t3” or “qos_gpu-t4” or “qos_gpu-dev”, optional

Quality of Service (QoS) used to submit job

walltime : str, optional, default “01:00:00”

maximum walltime of the submited job, in the format ‘hh:mm:ss’

submit_sbatch : bool, optional, default True

Submit the job with sbatch. If false simply run it within the same instance

Requirements#

The current plugin requires the present plugins to run properly:

Requirement name

Requirement type

Explicit definition

Any valid

Default name

Default version

model

Model

True

True

None

None

YAML template#

Please find below a template for a YAML configuration:

 1platform:
 2  plugin:
 3    name: JEAN-ZAY
 4    version: std
 5    type: platform
 6
 7  # Optional arguments
 8  python: XXXXX  # str
 9  python_venv: XXXXX  # str
10  python_module: XXXXX  # str
11  project: XXXXX  # str
12  partition: XXXXX  # cpu_p1|prepost|visu|archive|compil|compil_h100|v100|a100|h100
13  gpu: XXXXX  # bool
14  nodes: XXXXX  # int
15  cores: XXXXX  # int
16  qos: XXXXX  # qos_cpu-t3|qos_cpu-t4|qos_cpu-dev|qos_gpu-t3|qos_gpu-t4|qos_gpu-dev
17  walltime: XXXXX  # str
18  submit_sbatch: XXXXX  # bool
Contents