How to use itdainb/PhoRanker with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="itdainb/PhoRanker")
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("itdainb/PhoRanker") model = AutoModelForSequenceClassification.from_pretrained("itdainb/PhoRanker", device_map="auto")
https://huggingface.co/itdainb/PhoRanker/resolve/main/bpe.codes
hf download hf://itdainb/PhoRanker/bpe.codes
curl -L -o bpe.codes https://huggingface.co/itdainb/PhoRanker/resolve/main/bpe.codes
