Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,106 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml
|
| 4 |
+
---
|
| 5 |
+
# Join our Discord! https://discord.gg/BeaverAI
|
| 6 |
+
## More than 8000 members strong 💪 A hub for users and makers alike!
|
| 7 |
+
---
|
| 8 |
+
## Drummer is open for new opportunites! Contact me through any of these channels: https://linktr.ee/thelocaldrummer
|
| 9 |
+
### Thank you to everyone who subscribed through [Patreon](https://www.patreon.com/TheDrummer). Your support helps me chug along in this brave new world.
|
| 10 |
+
|
| 11 |
+
### FAQ for those out-of-the-loop
|
| 12 |
+
|
| 13 |
+
<details>
|
| 14 |
+
<summary>🐶 Who is Drummer?</summary>
|
| 15 |
+
|
| 16 |
+
Hi! I'm Drummer. I'm a Software Engineer with experience in JavaScript, Golang, Python, and generally engineering the crap out of things.
|
| 17 |
+
|
| 18 |
+
Why I'm in the AI space:
|
| 19 |
+
|
| 20 |
+
- **Exploration:** Everyone is trying to figure out how AI works and what it's capable of. I am too - just not in creating the smartest, safest model at all costs.
|
| 21 |
+
- **Upskill:** The world is headed towards AI. It is here to stay. This has been my way of brushing up in this new form of computing challenge.
|
| 22 |
+
- **Value:** I yearn to create value. I feel satisfaction and fulfillment in providing something meaningful for others.
|
| 23 |
+
- **Fun:** It's just fun using and making models. It's also fun coming up with theories and realizing them in practice (training AI).
|
| 24 |
+
|
| 25 |
+
I started my tuning venture back in mid-2024 when I wanted to improve its literary capabilities.
|
| 26 |
+
I've come a long way since then and I have branched out and specialized.
|
| 27 |
+
Foundational models today are optimized for non-creative uses, and I believe there is a place for AI in creativity and entertainment.
|
| 28 |
+
|
| 29 |
+
I am here to take *the road less traveled by*.
|
| 30 |
+
|
| 31 |
+
</details>
|
| 32 |
+
|
| 33 |
+
<details>
|
| 34 |
+
<summary>❓ What are my models like?</summary>
|
| 35 |
+
|
| 36 |
+
**Bottomline:** My models are usually geared towards creativity, usability, and entertainment!
|
| 37 |
+
|
| 38 |
+
While intelligence, correctness, and problem solving are not my priority, they are still one of many qualities I want in my models.
|
| 39 |
+
|
| 40 |
+
The primary goal is to enhance the experience for users looking to use models for creative uses, and other use cases which require no alignment.
|
| 41 |
+
|
| 42 |
+
In an effort to make it clear to myself and to others what I'm aiming for, I've identified certain qualities that my users often want:
|
| 43 |
+
|
| 44 |
+
Creativity
|
| 45 |
+
- **Writing:** Does it string together words and sentences in a pleasant & effective way? Does it feel like a writer?
|
| 46 |
+
- **Dynamism:** How good is the AI at being compelling and intriguing in its storytelling?
|
| 47 |
+
- **Imagination:** Can the AI navigate through a plethora of possibilities? Can it skirt incoherence and rise up to absolute coherence at the end of it?
|
| 48 |
+
|
| 49 |
+
(Dis)alignment
|
| 50 |
+
- **Attitude:** Does it refuse in both soft or hard ways? Does it lean towards certain corporate/religious/political ethics & beliefs? How does it see the user and itself?
|
| 51 |
+
- **Morality:** Does it know ethics? Is its language infected with forced positivity? If not, can it still moralize over difficult & dubious themes?
|
| 52 |
+
- **Formatting:** How stubborn is it with its established formatting? Can it create effective and novel formats to answer the prompt?
|
| 53 |
+
|
| 54 |
+
Intelligence
|
| 55 |
+
- **Adherence:** Can it follow instructions? Is it sticking to the prompt? Can it understsand you?
|
| 56 |
+
- **Knowledge:** Does it know about the world in both fictional and non-fictional way?
|
| 57 |
+
- **Perception:** Can it handle nuance, complexity, and logic?
|
| 58 |
+
|
| 59 |
+
If it doesn't excel in one of these qualities, or if it's overall mediocre for its size, then I would most likely reiterate until I get something right.
|
| 60 |
+
|
| 61 |
+
</details>
|
| 62 |
+
|
| 63 |
+
<details>
|
| 64 |
+
<summary>💡 Philosophy</summary>
|
| 65 |
+
|
| 66 |
+
A person is defined by the language they use. Not whether they speak in English or German, but in how they perceive reality.
|
| 67 |
+
|
| 68 |
+
Just like how we associate a serial killer as a mind that can't map 'murder' to 'evil', an innocent person is a mind that simply can't imagine 'murder'. They get confused when forced to deal with such subjects.
|
| 69 |
+
|
| 70 |
+
AI's use of language speaks volumes about their 'perception' of reality. If a language model has been skewed and limited to a positive perception, then it's ability to imagine is also limited.
|
| 71 |
+
|
| 72 |
+
Finetuning is an opportunity to adjust and broaden the language. Corporations use it to achieve safety and compliance. I'm here to
|
| 73 |
+
|
| 74 |
+
</details>
|
| 75 |
+
|
| 76 |
+
---
|
| 77 |
+
|
| 78 |
+
[Drummer](https://huggingface.co/TheDrummer) proudly presents...
|
| 79 |
+
|
| 80 |
+
# Snowpiercer 15B v4 🚅
|
| 81 |
+
|
| 82 |
+

|
| 83 |
+
|
| 84 |
+
## Usage
|
| 85 |
+
|
| 86 |
+
- ChatML
|
| 87 |
+
|
| 88 |
+
# Description
|
| 89 |
+
|
| 90 |
+
> This is pretty good feels better than prior snowpiercer versions!
|
| 91 |
+
|
| 92 |
+
> It's better than any 12b model I've tried.
|
| 93 |
+
|
| 94 |
+
> It feels comparable to the last gen of 24Bs
|
| 95 |
+
|
| 96 |
+

|
| 97 |
+
|
| 98 |
+

|
| 99 |
+
|
| 100 |
+
## Links
|
| 101 |
+
- Original: https://huggingface.co/TheDrummer/Snowpiercer-15B-v4
|
| 102 |
+
- GGUF: https://huggingface.co/TheDrummer/Snowpiercer-15B-v4-GGUF
|
| 103 |
+
- iMatrix (recommended): https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v4-GGUF
|
| 104 |
+
- EXL3: https://huggingface.co/ArtusDev/TheDrummer_Snowpiercer-15B-v4-EXL3
|
| 105 |
+
|
| 106 |
+
`config-v3c`
|