Follow the PBS Pro Design Document Guidelines.

Links

• Link to discussion on Developer Forum: http://community.pbspro.org/t/remove-support-for-cpuset-mom/2066
• Link to a related design about replacing a cpuset optimization: To optimize job resource polling, discontinue reporting of resources_used values of PBS root jobs
• Link to pull request: <PR link if available>

Overview

The special pbs_mom.cpuset binary is only used in HPE systems MC990X/UV300 and ICE-X to run jobs using cpusets. There's special code in pbs_mom that is enclosed in #ifdef MOM_CPUSET that is compiled to create pbs_mom.cpuset. Now cgroups also supports cpusets, and running the standard pbs_mom with pbs_cgroups hook enabled works just as well.

Instead of running pbs_mom.cpuset, one can just enable the pbs_cgroups hook using the following steps:

1. qmgr -c "export hook pbs_cgroups application/x-config default pbs_cgroups.cf"
   This will create a file called "pbs_cgroups.cf" in the current directory.
2. edit the pbs_cgroups.cf file and set "vnode_per_numa_node" to true
   Example: "vnode_per_numa_node" : true
3. Re-import the updated hook config file:
   qmgr -c "import hook pbs_cgroups application/x-config default pbs_cgroups.cf"
4. Enable the cgroups hook:
   qmgr -c "set hook pbs_cgroups enabled=true"

For sites with large NUMA machines and machines with GPUs, it is recommended to set vnode_per_numa_node to true.

OSS Site Map

Project Documentation Main Page

Developer Guide Pages