read data is toomuch
hi so we are using convex for database storage - with just one person using it - my daily read and write database is coming to be 25 gb with read having most of the portions - and it hs only text that we storing in database one user doing calls to retrieve data from database - it feels very unusal that if things like apple notes consumes data in kb's but on convex teh read data is coming in gb for text files - any help would be appreciated?
16 Replies
Thanks for posting in <#1088161997662724167>.
Reminder: If you have a Convex Pro account, use the Convex Dashboard to file support tickets.
- Provide context: What are you trying to achieve, what is the end-user interaction, what are you seeing? (full error message, command output, etc.)
- Use search.convex.dev to search Docs, Stack, and Discord all at once.
- Additionally, you can post your questions in the Convex Community's <#1228095053885476985> channel to receive a response from AI.
- Avoid tagging staff unless specifically instructed.
Thank you!
hi! did you also send a support email?
just double checking
quick questions with database usage -- can you check your "server health" tab on the dashboard? see if there are any hints or warnings there to help optimize this. 98% of the time, the issue is a missing index
this is the section I'm referring to: https://docs.convex.dev/dashboard/deployments/health#insights
Health | Convex Developer Hub
Monitor your Convex deployment health including failure rates, cache performance, scheduler status, and deployment insights for optimization.
if you don't mind pasting your insights dashboard screenshot, we could take a look!
@Jamie
it would help to see Functions breakdown by project - then select Database Bandwidth in the dropdown on the right.
even after all optimizations its still half a gb per day w one user
make sure you are not using filters in convex functions and using collect with pagination
It's the weekend for the Convex team. Please be patient and he may get back to you on Monday if his time allows.
the section right below this called "insights" -- anything there?
all clear there
on this usage page, if you scroll down to show which functions are using the most bandwidth, are there any outliers?
i feel like all of them should have been in kb's since they are plain text i am not sure whey everything consumes mb's with single digit users- how can this scale with 10k or 100k users i am worried about that
There are endless ways to optimize. But a lot of websites with 100's of thousands of users remove high usage features. Run the axiom integration and that will show you more granular usage.
is that top function using
withIndex for every single ctx.db.query("...") call?
b/c this is looking unindexed to me