--- Causal Depthwise Conv1D (Mamba/SSM) Core operator in Mamba state-space models. Each channel is convolved independently with a causal filter: y[b,d,t] = bias[d] + Σ weight[d,k] * x[b,d,t-k], left-zero-padded for causality. Single dynamic Helion kernel specializes only on filter width W (unrolls the inner loop) while B, D, N stay dynamic — cutting JIT compilations from 8 down to 3, solving a 12-min CI timeout. Config autotuned on Nebius B200. ---
We implemented 4 GPU kernels using Helion DSL targeting NVIDIA B200 (Blackwell) GPUs: 1. causal_conv1d: Depthwise causal 1D convolution (core Mamba/Mamba-2…
Here's how each kernel works: 1. FP8 Quantization (fp8_quant) Memory-bound, fully parallel. Takes float32 activations, groups them (64-128…
using helion with NVIDIA ComputeIQ and TileIR.
fully autokernel generated
causal_conv1d: Causal depthwise 1D convolution with static per-shape configs and a stable fused convolution path; this is the highest-confidence officially…
GPU modders
