Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# RankingGPT-baichuan2-7b
|
| 2 |
|
| 3 |
RankingGPT is a text ranker based on large language models with significant in-domain and out-domain effectiveness.
|
|
@@ -39,6 +42,23 @@ score = torch.sum(logprobs)/logprobs.shape[0]
|
|
| 39 |
print(f"Document: {document[:20] + '...'} Score: {score}")
|
| 40 |
```
|
| 41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
### Citation
|
| 44 |
|
|
@@ -53,4 +73,4 @@ If you find our paper or models helpful, please consider citing them as follows:
|
|
| 53 |
archivePrefix={arXiv},
|
| 54 |
primaryClass={cs.IR}
|
| 55 |
}
|
| 56 |
-
```
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
# RankingGPT-baichuan2-7b
|
| 5 |
|
| 6 |
RankingGPT is a text ranker based on large language models with significant in-domain and out-domain effectiveness.
|
|
|
|
| 42 |
print(f"Document: {document[:20] + '...'} Score: {score}")
|
| 43 |
```
|
| 44 |
|
| 45 |
+
### Result
|
| 46 |
+
| | DL19 | DL20 | BEIR | url |
|
| 47 |
+
|---------|------|------|------|-----------------|
|
| 48 |
+
| MonoBERT-340M | 72.3 | 70.3 | 50.5 | [huggingface](https://huggingface.co/veneres/monobert-msmarco) |
|
| 49 |
+
| MonoT5-220M | 71.5 | 69.7 | 49.3 | [huggingface](https://huggingface.co/castorini/monot5-base-msmarco) |
|
| 50 |
+
| MonoT5-770M | 73.2 | 71.2 | 53.1 | [huggingface](https://huggingface.co/castorini/monot5-large-msmarco) |
|
| 51 |
+
| MonoT5-3B | 72.8 | 74.5 | 54.6 | [huggingface](https://huggingface.co/castorini/monot5-3b-msmarco) |
|
| 52 |
+
| RankT5-770M | - | - | 53.7 | [huggingface](https://huggingface.co/bergum/rank-T5-flan) |
|
| 53 |
+
| RankLLaMA| 74.6 | 76.6 | 52.5 | [huggingface](https://huggingface.co/castorini/rankllama-v1-7b-lora-passage) |
|
| 54 |
+
| RankingGPT-bloom-560m| 75.3 | 73.2 | 53.7 | [huggingface](https://huggingface.co/zyznull/RankingGPT-bloom-560m) [modelscope](https://modelscope.cn/models/damo/RankingGPT-bloom-560m) |
|
| 55 |
+
| RankingGPT-bloom-1b1| 75.6 | 73.2 | 54.5 | [huggingface](https://huggingface.co/zyznull/RankingGPT-bloom-1b1) [modelscope](https://modelscope.cn/models/damo/RankingGPT-bloom-1b1) |
|
| 56 |
+
| RankingGPT-bloom-3b| 76.8 | 73.6 | 56.2 | [huggingface](https://huggingface.co/zyznull/RankingGPT-bloom-3b) [modelscope](https://modelscope.cn/models/damo/RankingGPT-bloom-3b) |
|
| 57 |
+
| RankingGPT-bloom-7b| 77.3 | 74.6 | 56.6 | [huggingface](https://huggingface.co/zyznull/RankingGPT-bloom-7b) [modelscope](https://modelscope.cn/models/damo/RankingGPT-bloom-7b) |
|
| 58 |
+
| RankingGPT-llama2-7b| 76.2 | 76.3 | 57.8 | [huggingface](https://huggingface.co/zyznull/RankingGPT-llama2-7b) [modelscope](https://modelscope.cn/models/damo/RankingGPT-llama2-7b) |
|
| 59 |
+
| RankingGPT-baichuan2-7b| 75.9 | 74.3 | 57.5 | [huggingface](https://huggingface.co/zyznull/RankingGPT-baichuan2-7b) [modelscope](https://modelscope.cn/models/damo/RankingGPT-baichuan2-7b) |
|
| 60 |
+
| RankingGPT-qwen-7b| 75.8 | 74.3 | 58.3 | [huggingface](https://huggingface.co/zyznull/RankingGPT-qwen-7b) [modelscope](https://modelscope.cn/models/damo/RankingGPT-qwen-7b) |
|
| 61 |
+
|
| 62 |
|
| 63 |
### Citation
|
| 64 |
|
|
|
|
| 73 |
archivePrefix={arXiv},
|
| 74 |
primaryClass={cs.IR}
|
| 75 |
}
|
| 76 |
+
```
|