--- base_model: - TheDrummer/Snowpiercer-15B-v2 license: mit --- # Snowpiercer-15B-v2-exl2 Original model: [Snowpiercer-15B-v2](https://huggingface.co/TheDrummer/Snowpiercer-15B-v2) by [TheDrummer](https://huggingface.co/TheDrummer/Snowpiercer-15B-v2) Based on: [Apriel-Nemotron-15b-Thinker](https://huggingface.co/ServiceNow-AI/Apriel-Nemotron-15b-Thinker) by [ServiceNow-AI](https://huggingface.co/ServiceNow-AI) ## Quants [4bpw h6 (main)](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/main) [4.5bpw h6](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/4.5bpw-h6) [5bpw h6](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/5bpw-h6) [6bpw h6](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/6bpw-h6) [8bpw h8](https://huggingface.co/cgus/Snowpiercer-15B-v2-exl2/tree/8bpw-h8) ## Quantization notes Made with Exllamav2 0.3.1 with default dataset. These quants require RTX GPU on Windows or RTX/ROCm GPU on Linux and can be used with TabbyAPI or Text-Generation-WebUI. They require to be fully loaded into your GPU, if you have to rely on system RAM then GGUF quants is a better choice. # Original model card # Join our Discord! https://discord.gg/BeaverAI ## More than 6000 members of helpful, LLM enthusiasts! A hub for players and makers alike! --- Drummer proudly presents... # Snowpiercer 15B v2 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/XtzACixKJgJlPSMiCIvCC.png) ## Usage (Important) - Alpaca works best, don't ask why. - \ capable upon prefill! (Quality may vary for a small model, may require prompt wrangling) ## Description Snowpiercer 15B v2 - Knocks out the positivity for better steerability - Enhances the RP & creativity such as character adherence - Retains the intelligence & reasoning - Better than v1 (not a high bar, I know.) ## Special Thanks - Thank you to the testers at BeaverAI! You da MVP! ## Links - Original: https://huggingface.co/TheDrummer/Snowpiercer-15B-v2 - GGUF: https://huggingface.co/TheDrummer/Snowpiercer-15B-v2-GGUF - iMatrix (recommended): https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF - EXL3: https://huggingface.co/ArtusDev/TheDrummer_Snowpiercer-15B-v2-EXL3 `config-v1g`