Instructions to use johngiorgi/declutr-sci-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use johngiorgi/declutr-sci-base with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("johngiorgi/declutr-sci-base") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Commit ·
96b4361
1
Parent(s): 7628538
Add model_max_length argument to avoid warnings
Browse files- tokenizer_config.json +1 -1
tokenizer_config.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"add_special_tokens": false, "special_tokens_map_file": null, "full_tokenizer_file": null}
|
|
|
|
| 1 |
+
{"add_special_tokens": false, "special_tokens_map_file": null, "full_tokenizer_file": null, "model_max_length": 512}
|