TIL that there are React helpers there. I thought that there was only the tanstack query adapter for
TIL that there are React helpers there. I thought that there was only the tanstack query adapter for query caching.
16 Replies
Is it possible to create somehow event queue in convex. So function execution should be queued and executed in time intervals
Scheduling | Convex Developer Hub
Convex lets you easily schedule a function to run once or repeatedly in the
also the Workpool with parallelism limits and the ability to do
runAfter similar to the schedulerthanks. That's what I was looking for
this is what I received
on chef.convex.dev
I just started using it and it resulted in this
something that I am missing?
The more I work with it, the more I feel like convex is not meant to process large datasets. My opinion is based on:
- I migrated my most demanding real scenario to convex
- There are no examples for advanced use cases
- There no examples for data processing
When I ask in #general I get told that there a large code bases that use convex, but when I ask for examples or open source solutions nobody responds.
When I ask clear questions in the support-community I get no answers (probably because not many people use advanced use cases) or dont know how to execute it in Convex.
---
I just ported over a simple piece of the process that just loop trough all the data in batches and at this point in time it is still going for over 25 minutes, while the whole process in a MySQL query takes me 3 minutes.
I am also open for feedback and examples, but so far, nobody responded.
That was my vent, amen!
what complex data processing are you attempting to do? Convex is an OLTP database, so if you are attempting to do any kind of OLAP it is not built for it.
it won't do you any good to hear other use cases unless they are similar to yours. what is your use case - you can be generic and say the market if you don't want to diluge too much, e.g., CRM, IOT
My use case processing data to get the most trending items. It is for a analytics platform.
The exact code I want to port to convex which at the moment I process in MySQL itself is this: https://pastebin.com/anxVhRGM
And I understand that convex will be slower than native MySQL. If the DX is better than I dont mind if the process is a bit slower.
This is an enthusiastic but small community. It might take a few days for someone to have the time to devote to your complex case.
Convex is a document-oriented database optimised for reactivity, transactional guarantees, and providing a fully integrated type-safe backend. It performs best with flat data model, few joins (ideally none), and well targetted indexed queries for lightning fast lookups. It requires a paradigm shift in the way you think about your data model, especially if you're very used a SQL oriented approach.
https://claude.ai/share/c97a232a-6453-4f9a-9545-83b0d97ea249
If your first foray into Convex is directly porting that query and trying to run it over 10 millions rows, yeah you're going to have a few issues. It's not suited to OLAP style queries. It's like, the complete opposite
for analytics and trends you're better off using tinybird or bigquery - they are made exactly for this use case.
how i would build this - I would use convex for my OTLP and use their fivetran integration to stream the data to either tinybird or bigquery.
if using bigquery, you can create a materialized view that will update immediately upon the new data and make the view fresh. you could then ingest that data back to convex and make your trends dashboard live, or you could call the bigquery materialized view directly.
while you can peform these queries with MySQL, you really shouldn't. As you said, your mysql is taking 3minutes to respond. systems like tinybird and bigquery are optimized for queries and analysis
guys
howdy
Is the Convex Top Chef Hackathon all about 100% vibe coding? Can I still code with editor while using the Convex chef?
please make Chef use shadcn this will be the best thing that happened to web dev 🔥🔥