Resize embeddings layer
#2
by
Thalesian
- opened
I really want to adapt the T5Gemma family to a project I am working on to translate cuneiform tablets - but to do it I have to resize the embeddings layer to introduce token scripts. While this is easy to do for the traditional T5 family of models, I don't see how to do it here. Any guidance would be much appreciated. I can technically do it - but I just end up re-initiating a bunch of layers that erase the models ability to function.