Pinned Loading

1. mit-han-lab/qserve mit-han-lab/qserve Public

   QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

   Python 430 23

2. mit-han-lab/llm-awq mit-han-lab/llm-awq Public

   [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

   Python 2.5k 192

3. mit-han-lab/torchsparse mit-han-lab/torchsparse Public

   [MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

   Cuda 1.2k 143

4. mit-han-lab/lmquant mit-han-lab/lmquant Public

   Python 117 10

5. ys-2020.github.io ys-2020.github.io Public

   CSS