Multi-GPU Reduction & MatMul #1
Description
Current kernels are designed for a single-GPU execution. Let's scale them to multi-GPU systems. Ideally, using TMA and cooperative groups.
{{ message }}
Current kernels are designed for a single-GPU execution. Let's scale them to multi-GPU systems. Ideally, using TMA and cooperative groups.