💾 CPU model
13th Gen Intel(R) Core(TM) i5-13400TEF
🎮 GPU model
NVIDIA TITAN X (Pascal) 12GB
📊 Performance data
FP16
| model |
quant_int8 |
quant_float4 |
test |
t/s |
| rwkv7-g1-2.9b-20250519-ctx4096.st |
0 |
0 |
pp512 |
304.98 |
| rwkv7-g1-2.9b-20250519-ctx4096.st |
0 |
0 |
tg128 |
62.08 |
INT8
| model |
quant_int8 |
quant_float4 |
test |
t/s |
| rwkv7-g1-2.9b-20250519-ctx4096.st |
31 |
0 |
pp512 |
399.74 |
| rwkv7-g1-2.9b-20250519-ctx4096.st |
31 |
0 |
tg128 |
78.68 |
NF4
| model |
quant_int8 |
quant_float4 |
test |
t/s |
| rwkv7-g1-2.9b-20250519-ctx4096.st |
0 |
31 |
pp512 |
331.36 |
| rwkv7-g1-2.9b-20250519-ctx4096.st |
0 |
31 |
tg128 |
71.72 |
🛠️ System information [optional]
OS version:Windows11 PRO 25H2
driver version:581.80
CUDA version:13.0.97
🖥 Screenshot [optional]

💾 CPU model
13th Gen Intel(R) Core(TM) i5-13400TEF
🎮 GPU model
NVIDIA TITAN X (Pascal) 12GB
📊 Performance data
FP16
INT8
NF4
🛠️ System information [optional]
OS version:Windows11 PRO 25H2
driver version:581.80
CUDA version:13.0.97
🖥 Screenshot [optional]