YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This project pretrains a roberta-base on the Alemannic (als) data subset of the OSCAR corpus in JAX/Flax.

We will be using the masked-language modeling loss for pretraining.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support