Skip to content

Instantly share code, notes, and snippets.

@jnulzl
jnulzl / Qwen2.5-VL GPTQ.md
Created February 27, 2025 07:01
Qwen2.5-VL GPTQ量化教程

Qwen2.5-VL GPTQ量化教程

环境

  • 系统&软件:Ubuntu 20.04 + GTX 3090 + CUDA 11.8 + Python 3.10

依赖库

安装以下依赖库