Update README with HF usage

README.md

@@ -221,6 +221,54 @@ result = tokenizer.instruct_tokenizer.tokenizer.decode(out_tokens[0])
 print(result)
 ```
 
+### Usage in Hugging Face Transformers
+
+You can also use Hugging Face `transformers` library to run inference using various chat templates, or fine-tune the model.
+Example for inference:
+
+```python
+from transformers import LlamaTokenizerFast, MistralForCausalLM
+import torch
+
+device = "cuda"
+tokenizer = LlamaTokenizerFast.from_pretrained('mistralai/Mistral-Small-Instruct-2409')
+tokenizer.pad_token = tokenizer.eos_token
+
+model = MistralForCausalLM.from_pretrained('mistralai/Mistral-Small-Instruct-2409', torch_dtype=torch.bfloat16)
+model = model.to(device)
+
+prompt = "How often does the letter r occur in Mistral?"
+
+messages = [
+    {"role": "user", "content": prompt},
+ ]
+
+model_input = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to(device)
+gen = model.generate(model_input, max_new_tokens=150)
+dec = tokenizer.batch_decode(gen)
+print(dec)
+```
+
+And you should obtain 
+```text
+<s>
+  [INST]
+  How often does the letter r occur in Mistral?
+  [/INST]
+  To determine how often the letter "r" occurs in the word "Mistral,"
+  we can simply count the instances of "r" in the word.
+  The word "Mistral" is broken down as follows:
+    - M
+    - i
+    - s
+    - t
+    - r
+    - a
+    - l
+  Counting the "r"s, we find that there is only one "r" in "Mistral."
+  Therefore, the letter "r" occurs once in the word "Mistral."
+</s>
+```
 
 ## The Mistral AI Team