Spamming function calls on stream OpenAI responses
https://github.com/get-convex/convex-ai-chat/blob/main/convex/serve.ts#L70
Isn't a function trigger every time the a new token gets streamed?
const stream = await openai.chat.completions.create({
model: OPENAI_MODEL,
stream: true,
messages: [
{
role: "system",
content:
"Answer the user question based on the provided documents " +
"or report that the question cannot be answered based on " +
"these documents. Keep the answer informative but brief, " +
"do not enumerate all possibilities.",
},
...(relevantDocuments.map(({ text }) => ({
role: "system",
content: "Relevant document:\n\n" + text,
})) as ChatCompletionMessageParam[]),
...(messages.map(({ isViewer, text }) => ({
role: isViewer ? "user" : "assistant",
content: text,
})) as ChatCompletionMessageParam[]),
],
});
let text = "";
for await (const { choices } of stream) {
const replyDelta = choices[0].delta.content;
if (typeof replyDelta === "string" && replyDelta.length > 0) {
text += replyDelta;
await ctx.runMutation(internal.serve.updateBotMessage, {
messageId,
text,
});
}
}Why ctx.db is changing, and what you sho...
Nicolas · 2mo ago
## 🔐 Secure Webhook Log Streams Log stream requests sent to a webhook now include a cryptographic signature that you can check to make sure that the request comes from your Convex deployment. [Read the docs.](https://docs.convex.dev/production/integrations/log-streams/#securing-webhook-log-streams) ## 👁️ Hide Columns in the Dashboard There is a new menu in the dashboard *Data* page to reorder and hide columns. This is useful for projects that have a table with a lot of columns. [Check it out in the dashboard.](http://dashboard.convex.dev/deployment/data) ## ✨ Convex ESLint plugin The Convex ESLint rules are now out of beta. They enforce best practices for writing Convex code. We recommend setting them up in your projects. [Check out the docs.](https://docs.convex.dev/eslint) ## 💎 Zod 4 Support in convex-helpers The [Zod helpers in convex-helpers](https://github.com/get-convex/convex-helpers/blob/main/packages/convex-helpers/README.md#zod-validation) now support Zod 4. Zod 4’s Codecs feature makes it easy to serialize/deserialize function arguments and return values, as well as database values. [Learn more about Zod 4 support.](https://github.com/get-convex/convex-helpers/pull/840) **[Click here to get a shareable version of this post.](https://news.convex.dev/product-updates-volume-25/)**
Nicolas · 2mo ago
We have cool product updates to share! @everyone ## 👀 Preview Deployments for Everyone You no longer need to sign up for Convex Professional to use preview deployments: you can now use them with a free Convex account. [Read the docs.](https://docs.convex.dev/production/hosting/preview-deployments) ## 🤖 “Copy as Markdown” in Convex Docs It is now easier to add a page of the Convex documentation to your favorite LLM’s context: docs pages now have a “Copy as Markdown” button that copies a Markdown-formatted version of the page to your clipboard. [Go to Convex Docs.](https://docs.convex.dev/home) ## 🛡️ Additional Protection in `npx convex deploy` In the 1.30.0 version of the Convex CLI tool, the CLI will now ask for explicit confirmation before deleting large indexes (100,000+ documents). This helps avoid situations where an index is accidentally deleted and backfilling it takes a long time. [Read the changelog.](https://github.com/get-convex/convex-js/blob/main/CHANGELOG.md#1292) ## 📂 Exclude Files from Backups When using the Backups feature of Convex, you can now exclude file storage from backups. This can be useful when backing up very large projects. [Read the docs.](https://docs.convex.dev/database/backup-restore)
Nicolas · 2mo ago