Upload data_summary_card.md
#93
by
bsnelling
- opened
- data_summary_card.md +149 -0
data_summary_card.md
ADDED
|
@@ -0,0 +1,149 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
|
| 3 |
+
# Data Summary for microsoft_phi-1_5
|
| 4 |
+
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
|
| 8 |
+
|
| 9 |
+
## 1. General information
|
| 10 |
+
|
| 11 |
+
**1.0.1 Version of the Summary:** 1.0
|
| 12 |
+
|
| 13 |
+
|
| 14 |
+
|
| 15 |
+
**1.0.2 Last update:** 21-Nov-2025
|
| 16 |
+
|
| 17 |
+
|
| 18 |
+
|
| 19 |
+
## 1.1 Model Developer Identification
|
| 20 |
+
|
| 21 |
+
**1.1.1 Model Developer name and contact details:** Microsoft Corporation at One Microsoft Way, Redmond, WA 98052. Tel: 425-882-8080
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
## 1.2 Model Identification
|
| 26 |
+
|
| 27 |
+
**1.2.1 Versioned model name(s):** phi-1.5
|
| 28 |
+
|
| 29 |
+
|
| 30 |
+
|
| 31 |
+
**1.2.2 Model release date:** 09-Oct-2023
|
| 32 |
+
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
## 1.3 Overall training data size and characteristics
|
| 36 |
+
|
| 37 |
+
### 1.3.1 Size of dataset and characteristics
|
| 38 |
+
|
| 39 |
+
**1.3.1.A Text training data size:** 1 billion to 1 trillion tokens
|
| 40 |
+
|
| 41 |
+
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
|
| 45 |
+
**1.3.1.B Text training data content:** Same data sources as phi-1, augmented with various NLP synthetic texts generated by gpt-3.5-turbo-0301.
|
| 46 |
+
|
| 47 |
+
|
| 48 |
+
|
| 49 |
+
**1.3.1.C Image training data size:** Not applicable. Images are not part of the training data
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
**1.3.1.D Image training data content:** Not applicable
|
| 54 |
+
|
| 55 |
+
|
| 56 |
+
|
| 57 |
+
**1.3.1.E Audio training data size:** Not applicable. Audio data is not part of the training data
|
| 58 |
+
|
| 59 |
+
|
| 60 |
+
|
| 61 |
+
**1.3.1.F Audio training data content:** Not applicable
|
| 62 |
+
|
| 63 |
+
|
| 64 |
+
|
| 65 |
+
**1.3.1.G Video training data size:** Not applicable. Video data is not part of the training data
|
| 66 |
+
|
| 67 |
+
|
| 68 |
+
|
| 69 |
+
**1.3.1.H Video training data content:** Not applicable
|
| 70 |
+
|
| 71 |
+
|
| 72 |
+
|
| 73 |
+
**1.3.1.I Other training data size:** Not applicable
|
| 74 |
+
|
| 75 |
+
|
| 76 |
+
|
| 77 |
+
**1.3.1.J Other training data content:** Not applicable
|
| 78 |
+
|
| 79 |
+
|
| 80 |
+
|
| 81 |
+
**1.3.2 Latest date of data acquisition/collection for model training:** 08/31/2023
|
| 82 |
+
|
| 83 |
+
|
| 84 |
+
|
| 85 |
+
**1.3.3 Is data collection ongoing to update the model with new data collection after deployment?** No
|
| 86 |
+
|
| 87 |
+
|
| 88 |
+
|
| 89 |
+
**1.3.4 Date the training dataset was first used to train the model:** 09/01/2023
|
| 90 |
+
|
| 91 |
+
|
| 92 |
+
|
| 93 |
+
**1.3.5 Rationale or purpose of data selection:** Datasets focused on synthetic textbook-like texts and filtered code were chosen to teach common sense reasoning, general knowledge, and coding while reducing exposure to harmful web content. This supports research into safety, bias mitigation, and efficient learning using high-quality, curated data rather than generic web crawls
|
| 94 |
+
|
| 95 |
+
|
| 96 |
+
|
| 97 |
+
## 2. List of data sources
|
| 98 |
+
|
| 99 |
+
### 2.1 Publicly available datasets
|
| 100 |
+
|
| 101 |
+
**2.1.1 Have you used publicly available datasets to train the model?** Yes
|
| 102 |
+
|
| 103 |
+
|
| 104 |
+
|
| 105 |
+
## 2.2 Private non-publicly available datasets obtained from third parties
|
| 106 |
+
|
| 107 |
+
### 2.2.1 Datasets commercially licensed by rights holders or their representatives
|
| 108 |
+
|
| 109 |
+
**2.2.1.A Have you concluded transactional commercial licensing agreement(s) with rights holder(s) or with their representatives?** No
|
| 110 |
+
|
| 111 |
+
|
| 112 |
+
|
| 113 |
+
### 2.2.2 Private datasets obtained from other third-parties
|
| 114 |
+
|
| 115 |
+
**2.2.2.A Have you obtained private datasets from third parties that are not licensed as described in Section 2.2.1, such as data obtained from providers of private databases, or data intermediaries?** No
|
| 116 |
+
|
| 117 |
+
|
| 118 |
+
|
| 119 |
+
## 2.3 Personal Information
|
| 120 |
+
|
| 121 |
+
**2.3.1 Was personal data used to train the model?** Microsoft follows all relevant laws and regulations pertaining to personal information
|
| 122 |
+
|
| 123 |
+
|
| 124 |
+
|
| 125 |
+
## 2.4 Synthetic data
|
| 126 |
+
|
| 127 |
+
**2.4.1 Was any synthetic AI-generated data used to train the model?** Yes
|
| 128 |
+
|
| 129 |
+
|
| 130 |
+
|
| 131 |
+
## 3. Data processing aspects
|
| 132 |
+
|
| 133 |
+
### 3.1 Respect of reservation of rights from text and data mining exception or limitation
|
| 134 |
+
|
| 135 |
+
**3.1.1 Does this dataset include any data protected by copyright, trademark, or patent?** Microsoft follows all required regulations and laws for processing data protected by copyright, trademark, or patent
|
| 136 |
+
|
| 137 |
+
|
| 138 |
+
|
| 139 |
+
## 3.2 Other information
|
| 140 |
+
|
| 141 |
+
**3.2.1 Does the dataset include information about consumer groups without revealing individual consumer identities?** Microsoft follows all required regulations and laws for protecting consumer identities
|
| 142 |
+
|
| 143 |
+
|
| 144 |
+
|
| 145 |
+
**3.2.2 Was the dataset cleaned or modified before model training?** Yes
|
| 146 |
+
|
| 147 |
+
|
| 148 |
+
|
| 149 |
+
|