How exactly do we get scalar quantization and product quantization?

#23
by masdeval - opened

How do we get an embedding with float16 values?

Is the truncation the way to get the benefit of MRL? So, this means that mxbai-embed-large-v1 was trained to return 1024 dimension embedding but, because it uses MRL, we can safely get only the first 512 values?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment