Upload GGUF quants

Files changed (10) hide show

Luau-Devstral-24B-Instruct-v0.2-BF16.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:8a0fbf14af8c91ddcf38ee1bf3c30e3f8b8996389d299f9dcae5971ccdd7ed83
+size 47153529376

Luau-Devstral-24B-Instruct-v0.2-IQ1_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:c09085148084c29bdfb68de71343ae0a7d23c6f7ceca5109b5bed29812cbafc3
+size 5750506304

Luau-Devstral-24B-Instruct-v0.2-IQ2_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:226601ee967bcbd984049c4ee96e832831e4616ebf714410ab742e1265a4b500
+size 8114062144

Luau-Devstral-24B-Instruct-v0.2-IQ3_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:56c15ffcda774eb7e6b46862ae8ecf54da333a2fab6b9571dc43dd5806abe485
+size 10650960704

Luau-Devstral-24B-Instruct-v0.2-IQ4_XS.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:aab5acc21119980ad7ba7724bf17322dbd2508f54dbf09901bda8b5eb2ba69d2
+size 12758926144

Luau-Devstral-24B-Instruct-v0.2-Q4_K_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:e40924d33047390bb043fb9933d53e535652a1cf2da4568ecaa4fbef26c32e54
+size 14333920064

Luau-Devstral-24B-Instruct-v0.2-Q5_K_M.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:fba8cf275a65e2a87112d520f9b3df07d2a4760d611d6fc4d48270fad17f1462
+size 16763994944

Luau-Devstral-24B-Instruct-v0.2-Q6_K.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:b6270dd63a07e38b6d839019cb1a1b90430ae8fd61656add4976e4527efc8378
+size 19345949504

Luau-Devstral-24B-Instruct-v0.2-Q8_0.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:d2a7b3527af77703d74a2f7f946e49f483f3bc8b42948611d683e8cb8e6b25de
+size 25054790464

imatrix.gguf ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:f66d79fa3b8df6b0c895093b920284f35183da0a1888de7170b8ca7e39c166b5
+size 10037408