1bitLLM
/

bitnet_b1_58-3B

Text Generation

text-generation-inference

Model card Files Files and versions

Resources

View closed (1)

Add metadata and link to paper

#12 opened 8 months ago by

can you provide wikitest ppl and c4 ppl separately?

#11 opened over 1 year ago by

Can you provide more details on the training?

#10 opened over 1 year ago by

Any plans to use MQA (multi-query attention) or GQA (grouped-query attention) in the future?

#9 opened over 1 year ago by

Efficient Inference Kernel Support for 1.58bit.

#8 opened over 1 year ago by

This code from BitLinear doesn't make sense

#7 opened over 1 year ago by

Is it bitnet {-1,0,1}?

#6 opened over 1 year ago by

ValueError: Tokenizer class BitnetTokenizer does not exist or is not currently imported.

#5 opened over 1 year ago by

ryanzhangofficial

Longer inference time

#4 opened over 1 year ago by

Why are these models fp32?

#2 opened over 1 year ago by

Is there a chat/instruct model in plans?

#1 opened over 1 year ago by