Training in progress epoch 0

README.md

@@ -14,9 +14,9 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: 6.4978
-- Validation Loss: 6.3516
-- Epoch: 1
+- Train Loss: 7.3123
+- Validation Loss: 6.7670
+- Epoch: 0
 
 ## Model description
 
@@ -42,13 +42,12 @@ The following hyperparameters were used during training:
 
 | Train Loss | Validation Loss | Epoch |
 |:----------:|:---------------:|:-----:|
-| 7.3180     | 6.7701          | 0     |
-| 6.4978     | 6.3516          | 1     |
+| 7.3123     | 6.7670          | 0     |
 
 
 ### Framework versions
 
-- Transformers 4.19.0.dev0
-- TensorFlow 2.8.0-rc0
-- Datasets 2.1.1.dev0
+- Transformers 4.21.0.dev0
+- TensorFlow 2.9.1
+- Datasets 2.3.3.dev0
 - Tokenizers 0.11.0

config.json

@@ -32,7 +32,7 @@
       "max_length": 50
     }
   },
-  "transformers_version": "4.19.0.dev0",
+  "transformers_version": "4.21.0.dev0",
   "use_cache": true,
   "vocab_size": 50257
 }

special_tokens_map.json

@@ -1 +1,5 @@
-{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}
+{
+  "bos_token": "<|endoftext|>",
+  "eos_token": "<|endoftext|>",
+  "unk_token": "<|endoftext|>"
+}

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:132c400c36da2261f2003983399adb78b02cc7a31470e45314366f3e888254f5
+oid sha256:d58b5446148b73d2c8cfc62cc0990f00fd46a64a4e84e74b84749995333b1034
 size 497935464

tokenizer_config.json

@@ -1 +1,10 @@
-{"unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "sgugger/gpt2-like-tokenizer", "tokenizer_class": "GPT2Tokenizer"}
+{
+  "add_prefix_space": false,
+  "bos_token": "<|endoftext|>",
+  "eos_token": "<|endoftext|>",
+  "model_max_length": 1024,
+  "name_or_path": "sgugger/gpt2-like-tokenizer",
+  "special_tokens_map_file": null,
+  "tokenizer_class": "GPT2Tokenizer",
+  "unk_token": "<|endoftext|>"
+}