Hugging Face's logo

ArtusDev
/
gustavecortal_Beck-8B-EXL3

Text Generation
English
philosophy
psychology
reasoning
social
emotion
psychotherapy
exl3
Model card Files
xet
Community
ArtusDev commited on
Commit
ee2dc91
·
verified ·
1 Parent(s): 16bfe3b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +236 -30
README.md CHANGED
@@ -18,40 +18,246 @@ tags:
18
  - psychotherapy
19
  - exl3
20
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- ## EXL3 Quants of gustavecortal/Beck-8B
23
 
24
- EXL3 quants of [gustavecortal/Beck-8B](https://huggingface.co/gustavecortal/Beck-8B) using <a href="https://github.com/turboderp-org/exllamav3/">exllamav3</a> for quantization.
 
 
 
 
 
25
 
26
- ### Quants
27
- | Quant(Revision) | Bits per Weight | Head Bits |
28
- | -------- | ---------- | --------- |
29
- | [2.5_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
30
- | [3.0_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
31
- | [3.5_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
32
- | [4.0_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
33
- | [4.5_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.5bpw_H6) | 4.5 | 6 |
34
- | [5.0_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
35
- | [6.0_H6](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
36
- | [8.0_H8](https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/8.0bpw_H8) | 8.0 | 8 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
37
 
38
- ### Downloading quants with huggingface-cli
 
 
 
 
 
 
 
 
 
 
 
 
 
39
 
40
- <details>
41
- <summary>Click to view download instructions</summary>
 
 
 
 
 
 
 
42
 
43
- Install hugginface-cli:
 
 
 
 
 
44
 
45
- ```bash
46
- pip install -U "huggingface_hub[cli]"
47
- ```
48
-
49
- Download quant by targeting the specific quant revision (branch):
50
-
51
- ```
52
- huggingface-cli download ArtusDev/gustavecortal_Beck-8B-EXL3 --revision "5.0bpw_H6" --local-dir ./
53
- ```
54
- </details>
55
-
56
- ### Acknowledgements
57
- **Made possible with the help of cloud compute from [***lium.io***](https://lium.io/)**
 
18
  - psychotherapy
19
  - exl3
20
  ---
21
+ <style>
22
+ .container-dark {
23
+ font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", Arial, sans-serif;
24
+ line-height: 1.6;
25
+ color: #d4d4d4;
26
+ }
27
+ a {
28
+ color: #569cd6;
29
+ text-decoration: none;
30
+ font-weight: 600;
31
+ }
32
+ a:hover {
33
+ text-decoration: underline;
34
+ }
35
+ .card-dark {
36
+ background-color: #252526;
37
+ border-radius: 12px;
38
+ padding: 24px;
39
+ margin-bottom: 20px;
40
+ box-shadow: 0 4px 12px rgba(0,0,0,0.3);
41
+ border: 1px solid #3c3c3c;
42
+ }
43
+ .card-dark h1 {
44
+ font-size: 2.2em;
45
+ color: #ffffff;
46
+ text-align: center;
47
+ margin-bottom: 10px;
48
+ }
49
+ .card-dark.card-dark-title h1 {
50
+ font-size: 1.5em;
51
+ }
52
+ .card-dark .subtitle {
53
+ text-align: center;
54
+ font-size: 1.1em;
55
+ color: #a0a0a0;
56
+ }
57
+ .card-dark h2 {
58
+ font-size: 1.5em;
59
+ margin-top: 0;
60
+ padding-bottom: 10px;
61
+ border-bottom: 1px solid #3c3c3c;
62
+ color: #c586c0;
63
+ }
64
+ .card-dark h3 {
65
+ font-size: 1.2em;
66
+ color: #d4d4d4;
67
+ }
68
+ .styled-table {
69
+ display: table;
70
+ border: none;
71
+ width: 100%;
72
+ font-size: 0.95em;
73
+ margin-bottom: 0px;
74
+ }
75
+ .styled-table thead th {
76
+ background-color: #333333;
77
+ color: #c586c0;
78
+ text-align: left;
79
+ }
80
+ .styled-table th {
81
+ padding: 12px 15px;
82
+ }
83
+ .styled-table td {
84
+ padding: 0;
85
+ }
86
+ .styled-table table, .styled-table th, .styled-table td {
87
+ border-left: none;
88
+ border-right: none;
89
+ border-bottom: none;
90
+ }
91
+ .styled-table td {
92
+ border-bottom: 1px solid #3c3c3c;
93
+ }
94
+ .styled-table tbody tr {
95
+ transition: background-color 0.1s ease;
96
+ }
97
+ .styled-table tbody tr:hover {
98
+ background-color: #3a3a3a;
99
+ }
100
+ .styled-table tr:last-child td {
101
+ border-bottom: none;
102
+ }
103
+ .styled-table td a {
104
+ display: block;
105
+ padding: 12px 15px;
106
+ }
107
+ .styled-table td a.fake-link {
108
+ text-decoration:none;
109
+ color:inherit;
110
+ }
111
+ details {
112
+ margin-top: 20px;
113
+ border: 1px solid #3c3c3c;
114
+ border-radius: 8px;
115
+ overflow: hidden;
116
+ }
117
+ summary {
118
+ cursor: pointer;
119
+ padding: 12px 18px;
120
+ background-color: #6A5ACD;
121
+ font-weight: 600;
122
+ display: flex;
123
+ align-items: center;
124
+ gap: 10px;
125
+ justify-content: space-between;
126
+ list-style: none;
127
+ }
128
+ summary::-webkit-details-marker {
129
+ display: none;
130
+ }
131
+ summary:hover {
132
+ filter: brightness(1.1);
133
+ }
134
+ summary::after {
135
+ content: '';
136
+ display: inline-block;
137
+ width: 8px;
138
+ height: 8px;
139
+ border-bottom: 2px solid white;
140
+ border-right: 2px solid white;
141
+ transform: rotate(45deg);
142
+ transition: transform 0.3s ease;
143
+ }
144
+ details[open] > summary::after {
145
+ transform: rotate(225deg);
146
+ }
147
+ .details-content {
148
+ padding: 18px;
149
+ }
150
+ .btn-purple {
151
+ display: inline-block;
152
+ background-color: #6A5ACD;
153
+ color: white !important;
154
+ padding: 12px 24px;
155
+ border-radius: 8px;
156
+ text-decoration: none;
157
+ font-weight: 600;
158
+ transition: background-color 0.3s ease, transform 0.2s ease;
159
+ text-align: center;
160
+ }
161
+ .btn-purple:hover {
162
+ background-color: #7B68EE;
163
+ transform: translateY(-2px);
164
+ }
165
+ </style>
166
 
167
+ <div class="container-dark">
168
 
169
+ <div class="card-dark card-dark-title">
170
+ <h1>ArtusDev/gustavecortal_Beck-8B-EXL3</h1>
171
+ <p class="subtitle">
172
+ EXL3 quants of <a href="https://huggingface.co/gustavecortal/Beck-8B" target="_blank">gustavecortal/Beck-8B</a> using <a href="https://github.com/turboderp-org/exllamav3/" target="_blank">exllamav3</a> for quantization.
173
+ </p>
174
+ </div>
175
 
176
+ <div class="card-dark">
177
+ <h2>Quants</h2>
178
+ <table class="styled-table">
179
+ <thead>
180
+ <tr>
181
+ <th>Quant</th>
182
+ <th>BPW</th>
183
+ <th>Head Bits</th>
184
+ </tr>
185
+ </thead>
186
+ <tbody>
187
+ <tr>
188
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/2.5bpw_H6" target="_blank">2.5_H6</a></td>
189
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/2.5bpw_H6" target="_blank">2.5</a></td>
190
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/2.5bpw_H6" target="_blank">6</a></td>
191
+ </tr>
192
+ <tr>
193
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.0bpw_H6" target="_blank">3.0_H6</a></td>
194
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.0bpw_H6" target="_blank">3.0</a></td>
195
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.0bpw_H6" target="_blank">6</a></td>
196
+ </tr>
197
+ <tr>
198
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.5bpw_H6" target="_blank">3.5_H6</a></td>
199
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.5bpw_H6" target="_blank">3.5</a></td>
200
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/3.5bpw_H6" target="_blank">6</a></td>
201
+ </tr>
202
+ <tr>
203
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.0bpw_H6" target="_blank">4.0_H6</a></td>
204
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.0bpw_H6" target="_blank">4.0</a></td>
205
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.0bpw_H6" target="_blank">6</a></td>
206
+ </tr>
207
+ <tr>
208
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.5bpw_H6" target="_blank">4.5_H6</a></td>
209
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.5bpw_H6" target="_blank">4.5</a></td>
210
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/4.5bpw_H6" target="_blank">6</a></td>
211
+ </tr>
212
+ <tr>
213
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/5.0bpw_H6" target="_blank">5.0_H6</a></td>
214
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/5.0bpw_H6" target="_blank">5.0</a></td>
215
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/5.0bpw_H6" target="_blank">6</a></td>
216
+ </tr>
217
+ <tr>
218
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/6.0bpw_H6" target="_blank">6.0_H6</a></td>
219
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/6.0bpw_H6" target="_blank">6.0</a></td>
220
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/6.0bpw_H6" target="_blank">6</a></td>
221
+ </tr>
222
+ <tr>
223
+ <td><a href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/8.0bpw_H8" target="_blank">8.0_H8</a></td>
224
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/8.0bpw_H8" target="_blank">8.0</a></td>
225
+ <td><a class="fake-link" href="https://huggingface.co/ArtusDev/gustavecortal_Beck-8B-EXL3/tree/8.0bpw_H8" target="_blank">8</a></td>
226
+ </tr>
227
+ </tbody>
228
+ </table>
229
+ </div>
230
 
231
+ <div class="card-dark">
232
+ <h2>How to Download and Use Quants</h2>
233
+ <p>You can download quants by targeting specific size using the Hugging Face CLI.</p>
234
+ <details>
235
+ <summary>Click for download commands</summary>
236
+ <div class="details-content">
237
+ <b>1. Install huggingface-cli:</b>
238
+ <pre><code>pip install -U "huggingface_hub[cli]"</code></pre>
239
+ <b>2. Download a specific quant:</b>
240
+ <pre><code>huggingface-cli download ArtusDev/gustavecortal_Beck-8B-EXL3 --revision "5.0bpw_H6" --local-dir ./</code></pre>
241
+ </div>
242
+ </details>
243
+ <p>EXL3 quants can be run with any inference client that supports EXL3, such as <a href="https://github.com/theroyallab/tabbyapi" target="_blank"><b>TabbyAPI</b></a>. Refer to <a href="https://github.com/theroyallab/tabbyAPI/wiki/01.-Getting-Started" target="_blank">documentation</a> for set up instructions.</p>
244
+ </div>
245
 
246
+ <div class="card-dark">
247
+ <h2>Quant Requests</h2>
248
+ <div style="text-align: center; margin-top: 25px;">
249
+ <a href="https://huggingface.co/ArtusDev/requests-exl/discussions/new?title=[MODEL_NAME_HERE]&description=[MODEL_HF_LINK_HERE]" class="btn-purple" target="_blank">Request EXL3 Quants</a>
250
+ </div>
251
+ <p class="subtitle">
252
+ See <a href="https://huggingface.co/ArtusDev/requests-exl" target="_blank">EXL community hub</a> for request guidelines.
253
+ </p>
254
+ </div>
255
 
256
+ <div class="card-dark">
257
+ <h2>Acknowledgements</h2>
258
+ <p style="text-align: center; font-size: 1.1em; margin-top: 10px;">
259
+ Made possible with cloud compute from <a href="https://lium.io/" target="_blank"><b>lium.io</b></a>
260
+ </p>
261
+ </div>
262
 
263
+ </div>