ibrahimyaacob
ibrahimyaacob2mo ago

how to query all rows (recursively) ?

i need to pull all the between two dates but i need to query an estimate of 1mil++ rows. I know convex doesnt like big queries, so im guessing i need to run in recursively untill it is exhausted.
3 Replies
Convex Bot
Convex Bot2mo ago
Thanks for posting in <#1088161997662724167>. Reminder: If you have a Convex Pro account, use the Convex Dashboard to file support tickets. - Provide context: What are you trying to achieve, what is the end-user interaction, what are you seeing? (full error message, command output, etc.) - Use search.convex.dev to search Docs, Stack, and Discord all at once. - Additionally, you can post your questions in the Convex Community's <#1228095053885476985> channel to receive a response from AI. - Avoid tagging staff unless specifically instructed. Thank you!
lee
lee2mo ago
how is this query kicked off and how are the results accumulated? you could do the loop from a node server or an action like this https://docs.convex.dev/database/pagination#paginating-manually or you could do a recursive query that saves the results to a separate table with the migrations component https://www.convex.dev/components/migrations
Convex
Migrations
Framework for long running data migrations of live data.
ibrahimyaacob
ibrahimyaacobOP5w ago
thanks, i'll take a look

Did you find this page helpful?