A mixed cluster support for PBS Pro
Follow the PBS Pro Design Document Guidelines.
Links
- Link to discussion on Developer Forum: <link to your project's discussion>
- Link to issue: <issue link if available>
- Link to pull request: <https://github.com/PBSPro/pbspro/pull/1219>
Overview
- Customers are looking for interoperability, i.e. a mixed cluster of windows and Linux compute nodes.
- Less maintenance for windows special code in Server/Sched/Comm and 3rd parties.
- Windows customers will get additional PBS features automatically.
System Architecture Diagram
Change's done so far:
- PBS_RSHD/pbs_rcp is replaced with OpenSSH sshd/scp for file transfers.
- Enabled Zlib library to PBS_MOM to understand compressed TPP messages from Linux server.
- Build POC customized RPM & MSI packages.
Demo:
My setup details:
- Host (BLRLAP796) – Windows 10 – CMDS & MoM1
- Guest VM (winvm) – Windows 10 – CMDS & MoM 2
- Guest VM (physics) – GNU/Linux – Server/Sched/Comm/MoM3
Instructions to install this POC build:
=============================
1) Install and setup OpenSSH using below link in all client/server/execution hosts.
https://winscp.net/eng/docs/guide_windows_openssh_server#windows_older
2) Install linux server RPM in GNU/Linux(CentOS7) platform with default config.
3) Install windows MSI in execution hosts.
a) Add PBS_SCP key,value in pbs.conf file (E.g: PBS_SCP="C:\Program Files\OpenSSH\scp.exe")
b) Update the PBS_SERVER value to corresponding Linux server host.
Points to consider:
==============
1) All the client/server/execution host should be resolvable using the DNS server or local "hosts" file.
2) Configure passwordless SCP from execution host to client host.
3) Only if needed, configure passwordless SCP between execution and server host. (For stagein)
4) Make sure firewall is disabled for SCP connection port 22. Else update the firewall table to allow it.
5) Job submission users should be present in all hosts.
Project Documentation Main Page