Upload data_summary_card.md

#93
by bsnelling - opened
Files changed (1) hide show
  1. data_summary_card.md +149 -0
data_summary_card.md ADDED
@@ -0,0 +1,149 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+ # Data Summary for microsoft_phi-1_5
4
+
5
+
6
+
7
+
8
+
9
+ ## 1. General information
10
+
11
+ **1.0.1 Version of the Summary:** 1.0
12
+
13
+
14
+
15
+ **1.0.2 Last update:** 21-Nov-2025
16
+
17
+
18
+
19
+ ## 1.1 Model Developer Identification
20
+
21
+ **1.1.1 Model Developer name and contact details:** Microsoft Corporation at One Microsoft Way, Redmond, WA 98052. Tel: 425-882-8080
22
+
23
+
24
+
25
+ ## 1.2 Model Identification
26
+
27
+ **1.2.1 Versioned model name(s):** phi-1.5
28
+
29
+
30
+
31
+ **1.2.2 Model release date:** 09-Oct-2023
32
+
33
+
34
+
35
+ ## 1.3 Overall training data size and characteristics
36
+
37
+ ### 1.3.1 Size of dataset and characteristics
38
+
39
+ **1.3.1.A Text training data size:** 1 billion to 1 trillion tokens
40
+
41
+
42
+
43
+
44
+
45
+ **1.3.1.B Text training data content:** Same data sources as phi-1, augmented with various NLP synthetic texts generated by gpt-3.5-turbo-0301.
46
+
47
+
48
+
49
+ **1.3.1.C Image training data size:** Not applicable. Images are not part of the training data
50
+
51
+
52
+
53
+ **1.3.1.D Image training data content:** Not applicable
54
+
55
+
56
+
57
+ **1.3.1.E Audio training data size:** Not applicable. Audio data is not part of the training data
58
+
59
+
60
+
61
+ **1.3.1.F Audio training data content:** Not applicable
62
+
63
+
64
+
65
+ **1.3.1.G Video training data size:** Not applicable. Video data is not part of the training data
66
+
67
+
68
+
69
+ **1.3.1.H Video training data content:** Not applicable
70
+
71
+
72
+
73
+ **1.3.1.I Other training data size:** Not applicable
74
+
75
+
76
+
77
+ **1.3.1.J Other training data content:** Not applicable
78
+
79
+
80
+
81
+ **1.3.2 Latest date of data acquisition/collection for model training:** 08/31/2023
82
+
83
+
84
+
85
+ **1.3.3 Is data collection ongoing to update the model with new data collection after deployment?** No
86
+
87
+
88
+
89
+ **1.3.4 Date the training dataset was first used to train the model:** 09/01/2023
90
+
91
+
92
+
93
+ **1.3.5 Rationale or purpose of data selection:** Datasets focused on synthetic textbook-like texts and filtered code were chosen to teach common sense reasoning, general knowledge, and coding while reducing exposure to harmful web content. This supports research into safety, bias mitigation, and efficient learning using high-quality, curated data rather than generic web crawls
94
+
95
+
96
+
97
+ ## 2. List of data sources
98
+
99
+ ### 2.1 Publicly available datasets
100
+
101
+ **2.1.1 Have you used publicly available datasets to train the model?** Yes
102
+
103
+
104
+
105
+ ## 2.2 Private non-publicly available datasets obtained from third parties
106
+
107
+ ### 2.2.1 Datasets commercially licensed by rights holders or their representatives
108
+
109
+ **2.2.1.A Have you concluded transactional commercial licensing agreement(s) with rights holder(s) or with their representatives?** No
110
+
111
+
112
+
113
+ ### 2.2.2 Private datasets obtained from other third-parties
114
+
115
+ **2.2.2.A Have you obtained private datasets from third parties that are not licensed as described in Section 2.2.1, such as data obtained from providers of private databases, or data intermediaries?** No
116
+
117
+
118
+
119
+ ## 2.3 Personal Information
120
+
121
+ **2.3.1 Was personal data used to train the model?** Microsoft follows all relevant laws and regulations pertaining to personal information
122
+
123
+
124
+
125
+ ## 2.4 Synthetic data
126
+
127
+ **2.4.1 Was any synthetic AI-generated data used to train the model?** Yes
128
+
129
+
130
+
131
+ ## 3. Data processing aspects
132
+
133
+ ### 3.1 Respect of reservation of rights from text and data mining exception or limitation
134
+
135
+ **3.1.1 Does this dataset include any data protected by copyright, trademark, or patent?** Microsoft follows all required regulations and laws for processing data protected by copyright, trademark, or patent
136
+
137
+
138
+
139
+ ## 3.2 Other information
140
+
141
+ **3.2.1 Does the dataset include information about consumer groups without revealing individual consumer identities?** Microsoft follows all required regulations and laws for protecting consumer identities
142
+
143
+
144
+
145
+ **3.2.2 Was the dataset cleaned or modified before model training?** Yes
146
+
147
+
148
+
149
+