RHEL9 upgrade: first commit includes by arswalid · Pull Request #879 · NatLabRockies/HPC

arswalid · 2026-07-13T23:47:17Z

Main changes OS CPE SLURM etc...
access information
module structure
- envs
- toolchains
- CPE
known issues and FAQs

- Main changes OS CPE SLURM etc... - access information - module structure - envs - toolchains - CPE - known issues and FAQs

mselensky · 2026-07-14T18:15:52Z

This PR looks good to me - no specific comments. This will be a helpful starting point for users as they onboard onto the RHEL9 nodes.

yandthj

@arswalid and @mselensky I didn't go through all of this but noticing a lot of formatting issues, etc. Can you please go through and verify that the heading capitalization, code highlighting, other formatting is consistent, that it's using NLR instead of NREL, and proofread?

yandthj · 2026-07-15T15:33:50Z

+
+- On RHEL 8, applications were installed under `/nopt/nrel/apps/`. A new directory, `/nopt/nlr/apps`, has been created for this transition.
+- Slurm for RHEL 9 is installed under `/nopt/slurm/latest` instead of `/nopt/slurm/current`.
+- The latest FastX server is running on `kd7.hpc.nrel.gov` and can be accessed with the FastX client or at <https://kd7.hpc.nrel.gov>.


Suggested change

- The latest FastX server is running on `kd7.hpc.nrel.gov` and can be accessed with the FastX client or at <https://kd7.hpc.nrel.gov>.

- The latest FastX server is running on `kd7.hpc.nlr.gov` and can be accessed with the FastX client or at <https://kd7.hpc.nlr.gov>.

yandthj · 2026-07-15T15:34:39Z

+- On RHEL 8, applications were installed under `/nopt/nrel/apps/`. A new directory, `/nopt/nlr/apps`, has been created for this transition.
+- Slurm for RHEL 9 is installed under `/nopt/slurm/latest` instead of `/nopt/slurm/current`.
+- The latest FastX server is running on `kd7.hpc.nrel.gov` and can be accessed with the FastX client or at <https://kd7.hpc.nrel.gov>.
+- Access to RHEL 9 login and compute nodes is restricted. Reach out to `hpc-help@nlr.gov` to get started on the newer software stack.


Suggested change

- Access to RHEL 9 login and compute nodes is restricted. Reach out to `hpc-help@nlr.gov` to get started on the newer software stack.

- Access to RHEL 9 login and compute nodes is restricted. Reach out to [hpc-help@nlr.gov](mailto:hpc-help@nlr.gov) to get started on the newer software stack.

yandthj · 2026-07-15T15:35:14Z

@@ -0,0 +1,68 @@
+# Accessing Kestrel RHEL9 
+
+## login Nodes


Suggested change

## login Nodes

## Login Nodes

yandthj · 2026-07-15T15:36:30Z

+
+## login Nodes
+Use the following login nodes to access upgraded RHEL 9 resources:
+


hostnames all need to use nlr instead of nrel

yandthj · 2026-07-15T15:38:13Z

+- GPU login node: `kl5.hpc.nrel.gov`
+- DAV node: `kd7.hpc.nrel.gov` 
+
+## ssh steps


Suggested change

## ssh steps

## SSH Steps

yandthj · 2026-07-15T15:41:07Z

+- DAV node: `kd7.hpc.nrel.gov` 
+
+## ssh steps
+1. SSH to one of the login nodes listed above.


The numbers aren't rendering correctly in markdown, they are all showing as "1."

yandthj · 2026-07-15T15:42:47Z

+
+## Known Issues
+
+- `openmpi` 5 works only with `mpirun` because Slurm is configured without PMIx.


Suggested change

- `openmpi` 5 works only with `mpirun` because Slurm is configured without PMIx.

- `openmpi5` works only with `mpirun` because Slurm is configured without PMIx.

yandthj · 2026-07-15T15:43:19Z

+## Known Issues
+
+- `openmpi` 5 works only with `mpirun` because Slurm is configured without PMIx.
+- `mpiifx` previously failed because of missing path definitions. This should be fixed; report if it still fails.


how should users report this?

yandthj · 2026-07-15T15:43:37Z

+
+### I cannot find the module I need.
+
+Use `module spider ModuleName` first to verify availability. If it still cannot be found, email `hpc-ticket` and the Apps team will follow up.


Suggested change

Use `module spider ModuleName` first to verify availability. If it still cannot be found, email `hpc-ticket` and the Apps team will follow up.

Use `module spider <ModuleName>` first to verify availability. If it still cannot be found, email `hpc-ticket` and the Apps team will follow up.

yandthj · 2026-07-15T15:43:58Z

+
+### I need to mix and match compilers and libraries/MPI. How can I do that?
+
+Modules do not support arbitrary mix-and-match combinations. For example, if `oneapi` is loaded, only software compiled with oneAPI is shown. For custom stacks, use Spack and contact `hpc-ticket` to be matched with a Spack expert.


please fix the email and use mailto like the rest of the codebase

yandthj · 2026-07-15T15:48:26Z

@@ -0,0 +1,26 @@
+# Getting Started
+


Since this the section heading page it might be nice to have a little intro/summary about the upgrade and why were are doing that. Could you write that @mselensky ?

mselensky · 2026-07-16T23:10:50Z

@yandthj thanks for catching those typos + good idea on the intro - let me know what you think!

RHEL9 upgrade: first commit includes

9c88def

- Main changes OS CPE SLURM etc... - access information - module structure - envs - toolchains - CPE - known issues and FAQs

arswalid assigned tdthatcher, yandthj and mselensky Jul 13, 2026

yandthj reviewed Jul 15, 2026

View reviewed changes

typo fixes and intro to os upgrade

0563353

yandthj approved these changes Jul 23, 2026

View reviewed changes

yandthj merged commit a723d96 into NatLabRockies:gh-pages Jul 23, 2026

	- The latest FastX server is running on `kd7.hpc.nrel.gov` and can be accessed with the FastX client or at <https://kd7.hpc.nrel.gov>.
	- The latest FastX server is running on `kd7.hpc.nlr.gov` and can be accessed with the FastX client or at <https://kd7.hpc.nlr.gov>.

	- Access to RHEL 9 login and compute nodes is restricted. Reach out to `hpc-help@nlr.gov` to get started on the newer software stack.
	- Access to RHEL 9 login and compute nodes is restricted. Reach out to [hpc-help@nlr.gov](mailto:hpc-help@nlr.gov) to get started on the newer software stack.


		## login Nodes
		Use the following login nodes to access upgraded RHEL 9 resources:


		## Known Issues

		- `openmpi` 5 works only with `mpirun` because Slurm is configured without PMIx.

	- `openmpi` 5 works only with `mpirun` because Slurm is configured without PMIx.
	- `openmpi5` works only with `mpirun` because Slurm is configured without PMIx.


		### I cannot find the module I need.

		Use `module spider ModuleName` first to verify availability. If it still cannot be found, email `hpc-ticket` and the Apps team will follow up.

	Use `module spider ModuleName` first to verify availability. If it still cannot be found, email `hpc-ticket` and the Apps team will follow up.
	Use `module spider <ModuleName>` first to verify availability. If it still cannot be found, email `hpc-ticket` and the Apps team will follow up.


		### I need to mix and match compilers and libraries/MPI. How can I do that?

		Modules do not support arbitrary mix-and-match combinations. For example, if `oneapi` is loaded, only software compiled with oneAPI is shown. For custom stacks, use Spack and contact `hpc-ticket` to be matched with a Spack expert.

Conversation

arswalid commented Jul 13, 2026

Uh oh!

mselensky commented Jul 14, 2026

Uh oh!

yandthj left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mselensky commented Jul 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

yandthj left a comment •

edited

Loading