// TOPIC CLUSTER TELEMETRY //

#cuda

Explore technical articles, benchmarks, and architectural blueprints categorized under #cuda on Tekromancy.

>_ INDEXED TRANSMISSIONS IN #CUDA

2 dispatches

Sep 27, 2026 #cuda

Bypassing the CPU Bottleneck: GPUDirect Storage (GDS) with NVMe-oF in AI Clusters

A deep dive into NVIDIA GPUDirect Storage (GDS) and NVMe over Fabrics: streaming massive multi-terabyte dataset shards directly into GPU HBM without CPU bounce buffers.

by Joshua Edward McLaughlin Cox Read →

Sep 27, 2026 #cuda

Speculative Decoding in Production: Accelerating LLM Inference Without Accuracy Loss

How speculative decoding leverages small draft models and vectorized tree verification to double generation speed on vLLM and TensorRT-LLM without sacrificing a single bit of model precision.

by Joshua Edward McLaughlin Cox Read →

← View All Dispatches & Field Notes