|
|
|
|
|
--- |
|
|
|
|
|
base_model: esm3-open |
|
|
|
|
|
library_name: esm3 |
|
|
|
|
|
--- |
|
|
|
|
|
|
|
|
|
|
|
# Model Card for Model-Demo-1.4B |
|
|
<slot name='description'> |
|
|
|
|
|
## Task type |
|
|
Protein-level Classification |
|
|
|
|
|
## Model input type |
|
|
AA Sequence |
|
|
|
|
|
## ESM3 Model config |
|
|
|
|
|
- **base_model:** esm3-open |
|
|
- **model_type:** ESM3 Fine-tuning |
|
|
- **task_type:** Protein-level Classification |
|
|
|
|
|
## Training config |
|
|
|
|
|
- **optimizer:** |
|
|
- **class:** AdamW |
|
|
- **betas:** (0.9, 0.98) |
|
|
- **weight_decay:** 0.01 |
|
|
- **learning rate:** 0.0005 |
|
|
- **epoch:** 5 |
|
|
- **batch size:** 1 |
|
|
- **precision:** 16-mixed |
|
|
|
|
|
|
