Hey team is there a way to extend the
Hey team - is there a way to extend the vector store dimension limit from 2048 to 4096? I find the 2048 embedding length to be quite restricting esp working on llama2 based embeddings (7b default size = 4096). Thank you!!🙏
3 Replies
@Sam J Hey Sam! Let me know if you have thoughts here. SO close to get local only model working! ❤️
Alternatively this other approach could work too, but something about Convex runtime didn't load wasm... https://discord.com/channels/1019350475847499849/1019350478817079338/1164073505642532945
or maybe @sujayakar knows the answer here too? lmk! 🙏
Hey @yokoli! Sorry for the delay. I'm optimistic that we could support 4096 in the future, but we don't have firm plans right now.
We're making good progress on increasing the limit on the number of vectors. As that's wrapping up I'll try and do some testing with larger vector sizes and see what we can come up with.
@presley is there a way we could get the wasm dependency working for that embeddings library?
i wonder if switching the action to node will help