Validate with Cluster Readiness Engine
I have spent a fair amount of time over the years standing up GPU clusters and then, almost immediately, asking myself "okay, but how do I actually know this thing is healthy?" We can check that the...
View ArticleManually Initializing and Unsealing HashiCorp Vault on Kubernetes
I recently was working with the open source project NICo using the setup script that provides automation for end-to-end installation of the solution in a Kubernetes cluster. One of those components is...
View ArticleCalico on Hyperconverged Kubernetes
In a previous blog I showed how to install and configure a three node high available Kubernetes cluster. That cluster was using Flannel as the CNI for networking. While Flannel is a perfectly...
View ArticleHyperConverged Kubernetes on Ubuntu
The following probably seems pretty inconsequential but having used OpenShift for a vast amount of time I figured it might be wise to brush up on other ways to provide a Kubernetes environment. In this...
View ArticleNVIDIA OVS-DOCA via On-Cluster Layer OpenShift
In a previous blog I wrote about using off-cluster layering of NVIDIA's OVS-DOCA. In this blog I want to use on-clustering layering which makes manageability even easier than with the off-cluster...
View ArticleOpenShift Passthrough For Some
I wanted to provide a simple mechanism to configure vfio-pci devices of a certain device type when some of those device types are in use by the base operating system. For example on some Grace Hopper...
View ArticleOpenShift Network Card Rail Mapping
The goal of this writeup is to provide a simple mechanism to map which GPUs are associated to which NICs on the same PCIe switch inside a physical system. This mapped information can then assist in...
View ArticleOpenShift Hosted Control Planes Multi-Arch
A hosted control plane (HCP) is a cloud-native architecture where the management components of a Red Hat® OpenShift® cluster, specifically the control plane, are decoupled from the worker nodes and...
View ArticleOpenShift On-Cluster Image Mode & Lustre Client
Image mode for OpenShift allows you to easily extend the functionality of your base RHCOS image by layering additional images onto the base image. This layering does not modify the base RHCOS image....
View ArticleNVIDIA Unified Fabric Manager (UFM) on RHEL9
The UFM platform empowers research and industrial data center operators to efficiently provision, monitor, manage, and preventively troubleshoot and maintain their high-performance InfiniBand...
View ArticleNVIDIA OVS-DOCA on OpenShift
Open vSwitch (OVS) is a software-based network technology that enhances virtual machine (VM) communication within internal and external networks. Typically deployed in the hypervisor, OVS employs a...
View ArticleContainerization of LLDP for OpenShift
LLDP, or Link Layer Discovery Protocol, is a standard IEEE 802.1AB protocol that allows network devices to advertise their information to directly connected neighbors, which helps in network topology...
View ArticleReal Time at The Edge
Edge computing is all the rage now given small devices can often provide the performance required to process the workload in the given edge location. However before migrating applications and...
View ArticleNVIDIA GPU Direct Storage on OpenShift
GPU Direct Storage enables a direct data path for direct memory access (DMA) transfers between GPU memory and storage, which avoids a bounce buffer through the CPU. Using this direct path can relieve...
View ArticleNVIDIA RDMA in OpenShift Virtualization
In this blog we want to explore using NVIDIA GPU Direct RDMA with OpenShift Virtualization. The question is why would we want to do so? Sometimes there might be some legacy applications that cannot...
View ArticleExploring the NVIDIA Maintenance Operator
The NVIDIA Maintenance Operator provides Kubernetes API(Custom Resource Definition) to allow node maintenance operators in K8s cluster in a coordinated manner. It performs some common operations to...
View ArticleChange Ipaddress of OpenShift Control Node
My OpenShift 4.16.25 nodes were using DHCP addresses for their ipaddresses. However the scope changed in the DHCP range and one of my nodes that had ipaddress 10.6.135.250 was no longer able to get...
View ArticleNVIDIA GPU Direct Storage on OpenShift
Welcome to the NVIDIA GPU Direct Storage on OpenShift workflow. The goal of this workflow is to understand and configure NVIDIA GPU Direct Storage for NVME devices in worker nodes of an OpenShift...
View ArticleRDMA: Shared, Hostdevice, Legacy SRIOV
In a previous blog we discussed how to configure RDMA on OpenShift in three distinct methods: RDMA shared, host device and legacy SRIOV. However one of the biggest questions coming out of that blog...
View ArticleMellanox Firmware Updates via OpenShift
Anyone who has worked with Mellnox/NVIDIA networking devices knows there is sometimes the necessity to upgrade the firmware either to providing new feature functionality or addressing a current bug in...
View Article