cognitivecomputations
/

DeepSeek-V3-AWQ

Text Generation

4-bit precision

Model card Files Files and versions Community

DeepSeek-V3-AWQ / README.md

Commit History

Update README.md to contain new benchmark for A100 and L40S.

8a9a35b
verified

v2ray commited on 19 days ago

Updated README.md to include better benchmark.

9880e56

v2ray commited on 22 days ago

Updated README.md to include the latest command and performance.

6c66c30
verified

v2ray commited on Feb 16

Updated README.md to include serving command and inference speed.

bad2c4b
verified

v2ray commited on Feb 2

Update README.md

950a929
verified

v2ray commited on Jan 24

Fixed cache and added prefill ability.

604068d

v2ray commited on Jan 6

Create README.md

4550fe1
verified

v2ray commited on Jan 6