gsaltintas commited on
Commit
084b73d
·
verified ·
1 Parent(s): 16e8d64

Upload maddition_360_held_out/flexitok--maddition_arb_Arab_360_overlap.json with huggingface_hub

Browse files
maddition_360_held_out/flexitok--maddition_arb_Arab_360_overlap.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"1": {"ratio_to_total_tokens": 0.20821114369501467, "expected_training_ratio_in_superset": 0.008008120911346717, "num_tokens": 71}, "2": {"ratio_to_total_tokens": 0.03225806451612903, "expected_training_ratio_in_superset": 0.002481389578163772, "num_tokens": 11}, "26": {"ratio_to_total_tokens": 0.7595307917888563, "expected_training_ratio_in_superset": 0.7595307917888563, "num_tokens": 259}, "total_training_compared_to_full_model": 0.7700203022783668}