meta-llama
/

Llama-3.1-405B-Instruct

Text Generation

text-generation-inference

Model card Files Files and versions

Resources

View closed (14)

Access request FAQ

#10 opened over 1 year ago by

Create a.html

#34 opened 9 days ago by

Model Access

#33 opened 7 months ago by

stevenpsupermicro

What Files Are Needed or All

#32 opened 10 months ago by

set "pad_token" to "<|finetune_right_pad_id|>"

#31 opened 12 months ago by

cannot get 405B-model to run

#30 opened about 1 year ago by

Llama 3.1 models continuously unavailable

#28 opened about 1 year ago by

potential of 405b model

#27 opened about 1 year ago by

Update tokenizer_config.json

#26 opened over 1 year ago by

Model inference giving 503 error

#25 opened over 1 year ago by

Num KV heads changed from 16 to 8?

#21 opened over 1 year ago by

This repo is huge!

#19 opened over 1 year ago by

Please reply, why am I not allowed to apply for approval? Aren't you open-source?

#18 opened over 1 year ago by

Inference Endpoint (dedicated) not available

#16 opened over 1 year ago by

why "num_key_value_heads": 16,

#14 opened over 1 year ago by

GGUF version request

#13 opened over 1 year ago by

🚀 LMDeploy support Llama3.1 and its Tool Calling. An example of calling "Wolfram Alpha" to perform complex mathematical calculations can be found from here!

#11 opened over 1 year ago by

TGI available only for pro subscriptions?

#7 opened over 1 year ago by

Max output tokens for Llama 3.1

#6 opened over 1 year ago by

abhirup-sainapse

Please move PTH/original into new model/repo.

#5 opened over 1 year ago by