A mixed cluster support for PBS Pro

Owned by Brem Anand
Last updated: Aug 19, 2019

Follow the PBS Pro Design Document Guidelines.

Overview

  • Customers are looking for interoperability, i.e. a mixed cluster of windows and Linux compute nodes.
  • Less maintenance for windows special code in Server/Sched/Comm and 3rd parties.
  • Windows customers will get additional PBS features automatically.

System Architecture Diagram



Change's done so far:

  • PBS_RSHD/pbs_rcp is replaced with OpenSSH sshd/scp for file transfers.
  • Enabled Zlib library to PBS_MOM to understand compressed TPP messages from Linux server.
  • Build POC customized RPM & MSI packages.


Demo: 

My setup details:

  • Host (BLRLAP796) – Windows 10   –  CMDS & MoM1
  • Guest VM (winvm) – Windows 10  –  CMDS & MoM 2
  • Guest VM (physics) – GNU/Linux   –  Server/Sched/Comm/MoM3



Instructions to install this POC build:
=============================

1) Install and setup OpenSSH using below link in all client/server/execution hosts.
https://winscp.net/eng/docs/guide_windows_openssh_server#windows_older

2) Install linux server RPM in GNU/Linux(CentOS7) platform with default config.

3) Install windows MSI in execution hosts.
a) Add PBS_SCP key,value in pbs.conf file (E.g: PBS_SCP="C:\Program Files\OpenSSH\scp.exe")
b) Update the PBS_SERVER value to corresponding Linux server host.


Points to consider:
==============

1) All the client/server/execution host should be resolvable using the DNS server or local "hosts" file.
2) Configure passwordless SCP from execution host to client host.
3) Only if needed, configure passwordless SCP between execution and server host. (For stagein)
4) Make sure firewall is disabled for SCP connection port 22. Else update the firewall table to allow it.
5) Job submission users should be present in all hosts.








OSS Site Map

Project Documentation Main Page

Developer Guide Pages