Follow the PBS Pro Design Document Guidelines.
Links
- Link to discussion on Developer Forum: http://community.pbspro.org/t/remove-support-for-cpuset-mom/2066
- Link to a related design about replacing a cpuset optimization: To optimize job resource polling, discontinue reporting of resources_used values of PBS root jobs
- Link to pull request: <PR link if available>
Overview
The special pbs_mom.cpuset binary is only used in HPE systems MC990X/UV300 and ICE-X to run jobs using cpusets. There's special code in pbs_mom that is enclosed in #ifdef MOM_CPUSET that is compiled to create pbs_mom.cpuset. Now cgroups also supports cpusets, and running the standard pbs_mom with pbs_cgroups hook enabled works just as well.
Instead of running pbs_mom.cpuset, one can just enable the pbs_cgroups hook using the following steps:
- qmgr -c "export hook pbs_cgroups application/x-config default pbs_cgroups.cf"
This will create a file called "pbs_cgroups.cf" in the current directory. - edit the pbs_cgroups.cf file and set "vnode_per_numa_node" to true
Example: "vnode_per_numa_node" : true - Edit the pbs_cgroups.cf file and set "use_hyperthreads" to true
Example: "use_hyperthreads" : true - Re-import the updated hook config file:
qmgr -c "import hook pbs_cgroups application/x-config default pbs_cgroups.cf" - Enable the cgroups hook:
qmgr -c "set hook pbs_cgroups enabled=true" - kill -HUP each pbs_mom so it can get the latest hook information
For sites with large NUMA machines and machines with GPUs, it is recommended to set vnode_per_numa_node to true.
Project Documentation Main Page