Fotiissss commited on
Commit
a5e0160
·
verified ·
1 Parent(s): f525dbb

Final model after 4000 steps

Browse files
README.md CHANGED
@@ -1,3 +1,83 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: peft
3
+ license: apache-2.0
4
+ base_model: openai/whisper-large-v3
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - wer
9
+ model-index:
10
+ - name: whisper-large-v3-turbo-lora-el
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # whisper-large-v3-turbo-lora-el
18
+
19
+ This model is a fine-tuned version of [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.1734
22
+ - Wer: 0.4643
23
+
24
+ ## Model description
25
+
26
+ More information needed
27
+
28
+ ## Intended uses & limitations
29
+
30
+ More information needed
31
+
32
+ ## Training and evaluation data
33
+
34
+ More information needed
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 1e-05
42
+ - train_batch_size: 2
43
+ - eval_batch_size: 8
44
+ - seed: 42
45
+ - gradient_accumulation_steps: 8
46
+ - total_train_batch_size: 16
47
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
+ - lr_scheduler_type: linear
49
+ - training_steps: 5000
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
54
+ |:-------------:|:--------:|:----:|:---------------:|:------:|
55
+ | 0.3662 | 10.4278 | 250 | 0.3702 | 0.5488 |
56
+ | 0.2983 | 20.8556 | 500 | 0.3048 | 0.5264 |
57
+ | 0.2742 | 31.2567 | 750 | 0.2839 | 0.5168 |
58
+ | 0.2647 | 41.6845 | 1000 | 0.2698 | 0.5096 |
59
+ | 0.242 | 52.0856 | 1250 | 0.2581 | 0.5085 |
60
+ | 0.2395 | 62.5134 | 1500 | 0.2471 | 0.5019 |
61
+ | 0.229 | 72.9412 | 1750 | 0.2371 | 0.4973 |
62
+ | 0.2187 | 83.3422 | 2000 | 0.2279 | 0.4955 |
63
+ | 0.2086 | 93.7701 | 2250 | 0.2192 | 0.4947 |
64
+ | 0.202 | 104.1711 | 2500 | 0.2113 | 0.4942 |
65
+ | 0.1952 | 114.5989 | 2750 | 0.2041 | 0.4936 |
66
+ | 0.1828 | 125.0 | 3000 | 0.1974 | 0.4805 |
67
+ | 0.1819 | 135.4278 | 3250 | 0.1918 | 0.4826 |
68
+ | 0.1748 | 145.8556 | 3500 | 0.1867 | 0.4786 |
69
+ | 0.1755 | 156.2567 | 3750 | 0.1825 | 0.4770 |
70
+ | 0.1719 | 166.6845 | 4000 | 0.1791 | 0.4708 |
71
+ | 0.169 | 177.0856 | 4250 | 0.1766 | 0.4707 |
72
+ | 0.1674 | 187.5134 | 4500 | 0.1748 | 0.4640 |
73
+ | 0.1662 | 197.9412 | 4750 | 0.1738 | 0.4643 |
74
+ | 0.1609 | 208.3422 | 5000 | 0.1734 | 0.4643 |
75
+
76
+
77
+ ### Framework versions
78
+
79
+ - PEFT 0.15.2
80
+ - Transformers 4.52.3
81
+ - Pytorch 2.6.0+cu124
82
+ - Datasets 3.6.0
83
+ - Tokenizers 0.21.1
runs/May29_23-58-08_caesar/events.out.tfevents.1748552289.caesar.1860085.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:acd14be26ce5fb5f840afb6de02a679f625386c50d66e82547248162cb0fc9af
3
- size 49532
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f1e0bc193e8194d98ce843dc705f49ccccceb907eb2e59f2cc6699585f58e3f
3
+ size 54742