Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mmnga
/
Llama-3.1-70B-Instruct-gguf

GGUF
English
Japanese
llama3.1
llama
imatrix
conversational
Model card Files Files and versions
xet
Community
Llama-3.1-70B-Instruct-gguf
190 GB
  • 1 contributor
History: 10 commits
mmnga's picture
mmnga
Upload Llama-3.1-70B-Instruct-IQ2_XXS.gguf with huggingface_hub
df6e084 verified over 1 year ago
  • .gitattributes
    1.95 kB
    Upload Llama-3.1-70B-Instruct-IQ2_XXS.gguf with huggingface_hub over 1 year ago
  • LICENSE
    7.63 kB
    Create LICENSE over 1 year ago
  • Llama-3.1-70B-Instruct-IQ2_XXS.gguf
    19.1 GB
    xet
    Upload Llama-3.1-70B-Instruct-IQ2_XXS.gguf with huggingface_hub over 1 year ago
  • Llama-3.1-70B-Instruct-IQ4_NL.gguf
    40.1 GB
    xet
    Upload Llama-3.1-70B-Instruct-IQ4_NL.gguf with huggingface_hub over 1 year ago
  • Llama-3.1-70B-Instruct-IQ4_XS.gguf
    37.9 GB
    xet
    Upload Llama-3.1-70B-Instruct-IQ4_XS.gguf with huggingface_hub over 1 year ago
  • Llama-3.1-70B-Instruct-Q4_K_M.gguf
    42.5 GB
    xet
    Upload Llama-3.1-70B-Instruct-Q4_K_M.gguf with huggingface_hub over 1 year ago
  • Llama-3.1-70B-Instruct-Q5_K_M.gguf.a
    49 GB
    xet
    Upload Llama-3.1-70B-Instruct-Q5_K_M.gguf.a with huggingface_hub over 1 year ago
  • Llama-3.1-70B-Instruct-Q5_K_M.gguf.b
    950 MB
    xet
    Upload Llama-3.1-70B-Instruct-Q5_K_M.gguf.b with huggingface_hub over 1 year ago
  • README.md
    873 Bytes
    Update README.md over 1 year ago