Update README.md

README.md

@@ -2,7 +2,7 @@
 license: apache-2.0
 datasets:
 - allenai/dolma
-- allenai/tulu-v2-sft-mixture
+- allenai/tulu-v2-sft-mixture-olmo-4096
 - allenai/ultrafeedback_binarized_cleaned
 language:
 - en
@@ -19,7 +19,7 @@ language:
 
 OLMo is a series of **O**pen **L**anguage **Mo**dels designed to enable the science of language models.
 The OLMo base models are trained on the [Dolma](https://huggingface.co/datasets/allenai/dolma) dataset.
-The adapted versions are trained on the [Tulu SFT mixture](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture) and, for the Instruct version, a [cleaned version of the UltraFeedback dataset](https://huggingface.co/datasets/allenai/ultrafeedback_binarized_cleaned).
+The adapted versions are trained on the [Tulu SFT mixture](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture-olmo-4096) and, for the Instruct version, a [cleaned version of the UltraFeedback dataset](https://huggingface.co/datasets/allenai/ultrafeedback_binarized_cleaned).
 
 OLMo 7B April 2024 Instruct and OLMo SFT are two adapted versions of these models trained for better question answering.
 They are based on the OLMo 7B April release (previously called OLMo 1.7).
@@ -30,8 +30,8 @@ They show the performance gain that OLMo base models can achieve with existing f
 We release two adapted model versions:
 | Model | Training Method(s) | Datasets | Context Length | 
 |------|--------|---------|--|
-| [OLMo 7B April 2024 SFT](https://huggingface.co/allenai/OLMo-1.7-7B-SFT-hf)   | SFT | [Tulu 2 SFT Mix](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture)     | 2048        | 
-| [OLMo 7B April 2024 Instruct](https://huggingface.co/allenai/OLMo-1.7-7B-Instruct-hf) | SFT + DPO   | [Tulu 2 SFT Mix](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture) + [Ultrafeedback Cleaned](https://huggingface.co/datasets/allenai/ultrafeedback_binarized_cleaned)     | 2048 |
+| [OLMo 7B April 2024 SFT](https://huggingface.co/allenai/OLMo-1.7-7B-SFT-hf)   | SFT | [Tulu 2 SFT Mix](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture-olmo-4096)     | 4096        | 
+| [OLMo 7B April 2024 Instruct](https://huggingface.co/allenai/OLMo-1.7-7B-Instruct-hf) | SFT + DPO   | [Tulu 2 SFT Mix](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture-olmo-4096) + [Ultrafeedback Cleaned](https://huggingface.co/datasets/allenai/ultrafeedback_binarized_cleaned)     | 4096 |
 
 These models are both trained on top of OLMo 7B April 2024 release (formerly called OLMo 1.7):
 | Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
@@ -106,7 +106,7 @@ Core model results for the 7B adapted models are found below.
 ## Model Details
 
 ### Data
-For training data details, please see the [Dolma](https://huggingface.co/datasets/allenai/dolma), [Tulu 2](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture), and [UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) documentation.
+For training data details, please see the [Dolma](https://huggingface.co/datasets/allenai/dolma), [Tulu 2](https://huggingface.co/datasets/allenai/tulu-v2-sft-mixture-olmo-4096), and [UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) documentation.
 
 ### Architecture