codeLlama-7b

README.md

@@ -5,16 +5,16 @@ tags:
 - generated_from_trainer
 base_model: codellama/CodeLlama-7b-hf
 model-index:
-- name: codellma-7b
+- name: codeLlma-7b
   results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# codellma-7b
+# codeLlma-7b
 
-This model is a fine-tuned version of [codellama/CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf) on the Nan-Do/code-search-net-java dataset.
+This model is a fine-tuned version of [codellama/CodeLlama-7b-hf](https://huggingface.co/codellama/CodeLlama-7b-hf) on the xfordanita/code-summary-java dataset.
 
 ## Model description
 
@@ -33,13 +33,14 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0002
+- learning_rate: 0.0001
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- training_steps: 150
+- lr_scheduler_warmup_steps: 50
+- training_steps: 50
 - mixed_precision_training: Native AMP
 
 ### Training results

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8983cf1f0854f599c470445fd58304a45720b1edb512fdb327d513eed9325bf9
+oid sha256:c15f620314ffeaf8e832c4f049820ff651d69b6157fe690b0c95e58a307679a2
 size 134235048

runs/Mar15_01-53-51_6feedeca1370/events.out.tfevents.1710467641.6feedeca1370.34.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:907820a6b16873257aac6c728021a367011f1615a46e52f25755c82b770a1c0a
+size 6754

runs/Mar15_02-01-03_6feedeca1370/events.out.tfevents.1710468072.6feedeca1370.34.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86795b83aee085df5fb4ea4c90259b1dc2fc90615b2286f056c0c378ca79d6a8
+size 5925

runs/Mar15_02-17-53_6feedeca1370/events.out.tfevents.1710469106.6feedeca1370.324.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5801cd60f2e9aff1f1c24165847a695a7020dcd1876be5bc4afae275decc9df4
+size 15793

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0dc5100bf472166abe215f594b3a9e2750abcc235d3e78c30c0e3f0f61b0d6ca
+oid sha256:b0629cc8fb2203335313b9b24886dd701b0dd2d1b1773c91640533d4a84af6fc
 size 4920