Suse-Ai-Factory

Building an ARM64 AI cluster by hand on SUSE Virtualization: PCI passthrough, NUMA, RDMA and SUSE AI Factory

Three VMs with an NVIDIA A2 and a BlueField-2 DPU passed through, pinned to the right NUMA node, provisioned by one cloud-config, joined to Rancher with Multus + Canal, and running a SUSE AI Factory blueprint. Pod-to-pod RDMA goes from 1.25 Gb/s to 24.51 Gb/s once the placement is right.

SUSE Virtualization on Vultr Bare Metal: An AI Web App on NVIDIA A16 GPUs with SUSE AI Factory

Architecture and implementation of a three-node SUSE Virtualization cluster on Vultr bare metal: Kube-OVN overlay networks over the Vultr VPC, Portworx and Longhorn storage, an RKE2 guest cluster with three NVIDIA A16 GPU workers, and a SUSE AI Factory blueprint that deploys vLLM and Open WebUI from Rancher.