Skip to content

[ web-rwkv report] NVIDIA TITAN X (Pascal) 12GB #28

@98Fengyu

Description

@98Fengyu

💾 CPU model

13th Gen Intel(R) Core(TM) i5-13400TEF

🎮 GPU model

NVIDIA TITAN X (Pascal) 12GB

📊 Performance data

FP16

model quant_int8 quant_float4 test t/s
rwkv7-g1-2.9b-20250519-ctx4096.st 0 0 pp512 304.98
rwkv7-g1-2.9b-20250519-ctx4096.st 0 0 tg128 62.08

INT8

model quant_int8 quant_float4 test t/s
rwkv7-g1-2.9b-20250519-ctx4096.st 31 0 pp512 399.74
rwkv7-g1-2.9b-20250519-ctx4096.st 31 0 tg128 78.68

NF4

model quant_int8 quant_float4 test t/s
rwkv7-g1-2.9b-20250519-ctx4096.st 0 31 pp512 331.36
rwkv7-g1-2.9b-20250519-ctx4096.st 0 31 tg128 71.72

🛠️ System information [optional]

OS version:Windows11 PRO 25H2
driver version:581.80
CUDA version:13.0.97

🖥 Screenshot [optional]

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions