jabra•2w ago

stream support for withSearchIndex ?

I really the new stream feature but it seems that it doesn't support withSearchIndex? Do you have an estimate when it will be implemented? https://github.com/get-convex/convex-helpers/blob/main/packages/convex-helpers/server/stream.ts#L602

withSearchIndex(_indexName: any, _searchFilter: any): any {
    throw new Error("Cannot paginate withSearchIndex");
  }

withSearchIndex(_indexName: any, _searchFilter: any): any {
    throw new Error("Cannot paginate withSearchIndex");
  }

GitHub

convex-helpers/packages/convex-helpers/server/stream.ts at main · ...

A collection of useful code to complement the official packages. - get-convex/convex-helpers

4 Replies

Convex Bot•2w ago

Thanks for posting in <#1088161997662724167>. Reminder: If you have a Convex Pro account, use the Convex Dashboard to file support tickets. - Provide context: What are you trying to achieve, what is the end-user interaction, what are you seeing? (full error message, command output, etc.) - Use search.convex.dev to search Docs, Stack, and Discord all at once. - Additionally, you can post your questions in the Convex Community's <#1228095053885476985> channel to receive a response from AI. - Avoid tagging staff unless specifically instructed. Thank you!

ian•2w ago

Unfortunately I don't think this will happen short term - the indexing of search works differently which makes it hard to arbitrarily paginate alongside normal indexed lookups afaict. I'm curious what your usecase is, what you're using the text search for, and what data you're hoping to join it with (or to just do multiple paginated queries?)

jabraOP•2w ago

@Ian I have a page where I list pods that the user is a member of with additional constraints. - Basic use case joining pods and members table using stream, that works - To filter with a selected category, I can merge the stream one above with podCategories table, that works Now to be able to add filter on pod's name query (searching on pod names that contain the search query) - I need to change the pods stream using WithSearchIndex to filter the pods using name and then merge then with member table and this is not supported

const podsStream =
      args.query?.name && args.query.name.trim() !== ''
        ? stream(ctx.db, schema)
            .query('pods')
            // .withSearchIndex('search_name', (q: any) =>
            //   q.search('name', args.query!.name!).eq('superPodId', args.superPodId)
            // )
            .withIndex('by_superPodId_name_start_time', (q) =>
              q.eq('superPodId', args.superPodId).gte('name', args.query!.name!)
            ).order('desc')
        : stream(ctx.db, schema)
            .query('pods')
            .withIndex('by_superPodId_start_time', (q) => q.eq('superPodId', args.superPodId))
            .order('desc')

const podsStream =
      args.query?.name && args.query.name.trim() !== ''
        ? stream(ctx.db, schema)
            .query('pods')
            // .withSearchIndex('search_name', (q: any) =>
            //   q.search('name', args.query!.name!).eq('superPodId', args.superPodId)
            // )
            .withIndex('by_superPodId_name_start_time', (q) =>
              q.eq('superPodId', args.superPodId).gte('name', args.query!.name!)
            ).order('desc')
        : stream(ctx.db, schema)
            .query('pods')
            .withIndex('by_superPodId_start_time', (q) => q.eq('superPodId', args.superPodId))
            .order('desc')

for now to make it not crash, I added gte but this is not what i need

ian•2w ago

Cool! I'm guessing the user is not part of more than dozens or hundreds of pods, so I'd suggest just doing a filter where you do whatever fuzzy string matching you want, I think you can even configure it to paginate but avoid reading too many rows (just returning fewer results in those cases)

stream support for withSearchIndex ?

Did you find this page helpful?