Instructions to use flax-community/gpt2-medium-indonesian with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use flax-community/gpt2-medium-indonesian with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="flax-community/gpt2-medium-indonesian")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("flax-community/gpt2-medium-indonesian")
model = AutoModelForCausalLM.from_pretrained("flax-community/gpt2-medium-indonesian", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use flax-community/gpt2-medium-indonesian with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "flax-community/gpt2-medium-indonesian"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "flax-community/gpt2-medium-indonesian",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/flax-community/gpt2-medium-indonesian

SGLang

How to use flax-community/gpt2-medium-indonesian with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "flax-community/gpt2-medium-indonesian" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "flax-community/gpt2-medium-indonesian",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "flax-community/gpt2-medium-indonesian" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "flax-community/gpt2-medium-indonesian",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use flax-community/gpt2-medium-indonesian with Docker Model Runner:
```
docker model run hf.co/flax-community/gpt2-medium-indonesian
```

gpt2-medium-indonesian

Commit History

put MODEL_DIR export separately

23930cb

cahya commited on Sep 2, 2021

reorder "import jax" to avoid the stuck on importing it, change the dataset

b25d188

cahya commited on Sep 2, 2021

added run finetuning

e5e9f73

cahya commited on Aug 31, 2021

updated minimal line length

8696911

cahya commited on Aug 31, 2021

delete .idea folder

06e1d8a

alvin commited on Aug 10, 2021

update <|endoftext|> tokenizer id from 50257 to 50256

34c19b7

alvin commited on Aug 10, 2021

refactor tokenizer related files with eos token

08d39dc

alvin commited on Aug 9, 2021

change endoftext value to len of tokenizer vocab size

07fc755

alvinwatner commited on Jul 26, 2021

fixed mismatched vocab_size between model and tokenizer

eb84e5f

alvin commited on Jul 26, 2021

Add bias analysis

83f2ae2

Galuh commited on Jul 19, 2021

Changed very long line to short multi lines to make it easier for editing in IDE.

5e570bf

cahya commited on Jul 19, 2021

Update README.md

d3d8b57

Galuh commited on Jul 19, 2021

Merge branch 'main' of https://huggingface.co/flax-community/gpt2-medium-indonesian into main

112770f

cahya commited on Jul 17, 2021

model udpate

02a615a

cahya commited on Jul 17, 2021

Update README.md

f50e22b

Galuh commited on Jul 17, 2021

Update README.md

79140ed

Galuh commited on Jul 17, 2021

Update README.md

311c294

Galuh commited on Jul 17, 2021

model update

c9d0885

cahya commited on Jul 17, 2021

model update

c6e87e7

cahya commited on Jul 16, 2021

added text collection

f126def

cahya commited on Jul 14, 2021

updated the models

ba4b314

cahya commited on Jul 14, 2021

updated the model

29adece

cahya commited on Jul 13, 2021

udpated the model and script to load local data

c15b9df

cahya commited on Jul 11, 2021

Saving weights and logs of step 65000

8ee977d

cahya commited on Jul 11, 2021