milk enjoyer
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
im not sure if it is worth not being able to send many in parallel reliably, since i can get aggregate by using a query each time too (as long as it doesnt exceed 16k documents), and the risk that data might be lost because my aggregate failed makes me very cautious to adopt it
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
i will try to find some reasonable middle ground for batching
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
unfortunately...
Uncaught Error: Uncaught Error: Too many bytes read in a single function execution (limit: 8388608 bytes). Consider using smaller limits in your queries, paginating your queries, or using indexed queries with a selective index range expressions.
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
might have fixed it. i will report back the next time i do a high volume write (all in one transaction)
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
let me double check
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
i think the new convex function was not deployed properly
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
ok wait a moment
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
yes
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
export const _updateMany = internalMutation({
args: {
input: zc(z.array(partialSchemaWithId)),
},
handler: async (ctx, args) => {
const { input } = args;
const updatedEntries = await Promise.all(
input.map(async (inputEntry) => {
const { _id, ...entryUpdate } = inputEntry;
const existingEntry = await ctx.skipRules.table(TABLE_NAME).getX(_id);
const updatedEntry = { ...existingEntry, ...entryUpdate };
if (isEqual({ ...existingEntry }, updatedEntry)) {
return existingEntry;
}
await existingEntry.replace(updatedEntry);
const entry = await ctx.skipRules.table(TABLE_NAME).getX(_id);
return entry;
}),
);
return updatedEntries;
},
});26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
i just converted my code to do all writes in a single mutation, and it still fails.
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
is aggregate just not meant to handle high volume? if so then i would rather accept this early and work around it (just dont use aggregate). i have tried many ways to improve the situation by spacing out the transactions as much as possible but there seems to be no way to get it to work reliably especially with high volume of transactions.
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
await sequentialPromiseAll(
addresses.map(async (address) => {
const entry = await ctx.runQuery(
internal.functions.wallet._getByUniqueFields,
{
input: {
address,
chain: "solana",
},
},
);
if (!entry) {
throw new Error("Wallet not found");
}
await ctx.runAction(api.functions.wallet.updateWallet, {
input: {
address,
},
});
}),
);
it was promise all, but promise all basically could barely run because everything was failing. i switched to sequential (basically awaiting each one, and it still fails, but less.
i have tested and confirmed that this only happens if i send muliple transactions at once, and if i space it out it will also work. but for my project i cannot afford to purposely slow it down so much as i have a high volume of data.26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
whenever i insert multiple documents into wallets it triggers and therefore triggers the error (does not matter what the update is)
26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
import { Triggers } from "convex-helpers/server/triggers";
import { DataModel } from "../_generated/dataModel";
import {
balanceAggregate,
liquidNetWorthAggregate,
netWorthAggregate,
tokenBalanceAggregate,
tokenNetWorthAggregate,
usdcBalanceAggregate,
usdtBalanceAggregate,
} from "../aggregates/wallet";
const triggers = new Triggers<DataModel>();
// Wallet Aggregate Triggers
triggers.register("wallets", balanceAggregate.trigger());
triggers.register("wallets", usdcBalanceAggregate.trigger());
triggers.register("wallets", usdtBalanceAggregate.trigger());
triggers.register("wallets", tokenBalanceAggregate.trigger());
triggers.register("wallets", liquidNetWorthAggregate.trigger());
triggers.register("wallets", tokenNetWorthAggregate.trigger());
triggers.register("wallets", netWorthAggregate.trigger());
export const wrapDB = triggers.wrapDB;26 replies
CCConvex Community
•Created by milk enjoyer on 12/24/2024 in #support-community
Aggregate (Convex Component) fails if multiple documents are added at once
yes i am. i tried it using insert and also using trigger
26 replies
CCConvex Community
•Created by milk enjoyer on 3/30/2024 in #support-community
Getting MissingAccessToken when deploying to prod
thanks!
10 replies
CCConvex Community
•Created by milk enjoyer on 3/30/2024 in #support-community
Getting MissingAccessToken when deploying to prod
Ah yes that was the problem I forgot to set that in prod
10 replies
CCConvex Community
•Created by milk enjoyer on 3/30/2024 in #support-community
Getting MissingAccessToken when deploying to prod
I also double checked the guide and I don’t see what could be wrong https://docs.convex.dev/production/hosting/vercel
10 replies
CCConvex Community
•Created by milk enjoyer on 3/30/2024 in #support-community
Getting MissingAccessToken when deploying to prod
I’m deploying on vercel by the way. When using the dev deploy key it works.
10 replies
CCConvex Community
•Created by milk enjoyer on 3/25/2024 in #support-community
Custom auth not working
yup, i sync my env vars between vercel and convex so the secret is shared
76 replies