---

base_model: ProTrekHub/Protein_Encoder_35M 

library_name: peft

---



# Model Card for Model-Demo-ProTrek-35M
## Base model

[ProTrekHub/Protein_Encoder_35M](https://huggingface.co/ProTrekHub/Protein_Encoder_35M)

## Task description

The task is to predict the protein solubility.

## Label meaning

Label 1 - soluble
Lable 0 - unsoluble



## Task type
Protein-level Classification

## Model input type
AA Sequence

## LoRA config

- **r:** 8
- **lora_dropout:** 0.0
- **lora_alpha:** 16
- **target_modules:** ['value', 'intermediate.dense', 'query', 'output.dense', 'key']
- **modules_to_save:** ['classifier']

## Training config

- **optimizer:**
  - **class:** AdamW
  - **betas:** (0.9, 0.98)
  - **weight_decay:** 0.01
- **learning rate:** 0.0005
- **epoch:** 5
- **batch size:** 1
- **precision:** 16-mixed