Convex processing large datasets and use cases
The more I work with it, the more I feel like convex is not meant to process large datasets. My opinion is based on:
- I migrated my most demanding real scenario to convex
- There are no examples for advanced use cases
- There no examples for data processing
When I ask in #general I get told that there a large code bases that use convex, but when I ask for examples or open source solutions nobody responds.
When I ask clear questions in the support-community I get no answers (probably because not many people use advanced use cases) or dont know how to execute it in Convex.
---
I just ported over a simple piece of the process that just loop trough all the data in batches and at this point in time it is still going for over 25 minutes, while the whole process in a MySQL query takes me 3 minutes.
I am also open for feedback and examples, but so far, nobody responded.
That was my vent, amen!
- I migrated my most demanding real scenario to convex
- There are no examples for advanced use cases
- There no examples for data processing
When I ask in #general I get told that there a large code bases that use convex, but when I ask for examples or open source solutions nobody responds.
When I ask clear questions in the support-community I get no answers (probably because not many people use advanced use cases) or dont know how to execute it in Convex.
---
I just ported over a simple piece of the process that just loop trough all the data in batches and at this point in time it is still going for over 25 minutes, while the whole process in a MySQL query takes me 3 minutes.
I am also open for feedback and examples, but so far, nobody responded.
That was my vent, amen!
