Precision Comparison
拖动滑块切换精度级别：
FP32
32 bits/param
70B → 280 GB
FP16/BF16
16 bits/param
70B → 140 GB
FP8
8 bits/param
70B → 70 GB
INT4
4 bits/param
70B → 35 GB