deepseek-ai
/

DeepSeek-V3

Text Generation

text-generation-inference

Model card Files Files and versions

DeepSeekDDM commited on Jan 24

Commit

108e1e0

·

verified ·

1 Parent(s): 4c1f24c

fix the calculation of act params

Files changed (1) hide show

README_WEIGHTS.md +1 -1

README_WEIGHTS.md CHANGED Viewed

@@ -18,7 +18,7 @@ The DeepSeek-V3 weight file consists of two main components: **Main Model Weight
   - Input/output embedding layers and a complete set of 61 Transformer hidden layers.
 - **Parameter Count**:
   - Total parameters: **671B**
-  - Activation parameters: **36.7B** (including 0.9B for Embedding and 0.9B for the output Head).
 #### Structural Details

   - Input/output embedding layers and a complete set of 61 Transformer hidden layers.
 - **Parameter Count**:
   - Total parameters: **671B**
+  - Activation parameters: **36.6B**.
 #### Structural Details