Popular repositories Loading

1. Nanoflow Nanoflow Public

   A throughput-oriented high-performance serving framework for LLMs

   Jupyter Notebook 936 46

2. Atom Atom Public

   [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

   Cuda 333 30

3. fiddler fiddler Public

   [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration

   Python 254 30

4. LiteASR LiteASR Public

   [EMNLP Main '25] LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation

   Python 143 5

5. lapidary lapidary Public archive

   Creating beautiful gem5 simulations

   C++ 49 13

6. DMon-AE DMon-AE Public

   DMon Prototype for OSDI 2021 Artifact Evaluation

   C++ 24 1