Hello!
Since it seems there is no implementation for quantized embeddings with the Functional interace available, I want to ask if there is a workaround to this?
To be specific: How can I use a Functional embedding with quantization?
Thanks!
Hello!
Since it seems there is no implementation for quantized embeddings with the Functional interace available, I want to ask if there is a workaround to this?
To be specific: How can I use a Functional embedding with quantization?
Thanks!
The only thing we support for quantized embeddings are modules. I think the only real workaround is converting to embedding modules unfortunately.