Running LLMs inside Convex
is it possible to run an LLM inside a convex action? has anyone tried?
2 Replies
You could probably run a crude LLM in the Node runtime with a native NPM dependency. Don't think anyone has tried this. We do recommend using platforms that are purpose-built for running LLMs / ML models in general.
yep fair enough 🙂