How to change the embedding dimision?
#19
by
storm2008
- opened
The output dimission is 1536. But it is too large for my application. How to reduce the output dimission?
An option for very few models is to use https://huggingface.co/blog/matryoshka if they are trained with matryoshka loss. This model was not trained with matryoshka loss, so you can't!