konkani-Llama
Collection
Fintuned LLama model for konkani β’ 1 item β’ Updated
How to use konkani/konkani-llama3.1-8b-instruct with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("konkani/konkani-llama3.1-8b-instruct", dtype="auto")How to use konkani/konkani-llama3.1-8b-instruct with Unsloth Studio:
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for konkani/konkani-llama3.1-8b-instruct to start chatting
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for konkani/konkani-llama3.1-8b-instruct to start chatting
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for konkani/konkani-llama3.1-8b-instruct to start chatting
pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
model_name="konkani/konkani-llama3.1-8b-instruct",
max_seq_length=2048,
)This model is a parameter-efficient fine-tune (LoRA) of Meta-Llama-3.1-8B-Instruct, specifically optimized for the Konkani language across its three official scripts: Devanagari, Romi (Latin), and Kannada. It was fine-tuned on the Konkani-Instruct-100k dataset.
First, make sure you have the required libraries installed:
pip install transformers torch accelerate peft
Base model
meta-llama/Llama-3.1-8B