Gary, el Pingüino Artefacto
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
This would be an option but I saw you can't chain it to a filter, so sadly it's wouldn't work for us
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
We need to do a cost charts because that implementation may be more expensive than running an elasticsearch cluster and do pooling to retreive the data almost in real time
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
The idea of buckets is still under discussion, we planned using a computed bucket based on the created timestamp of the invoices and only computed the aggregation of the N nearest buckets and the do the sum on the client, where N can be any range that the user providers. Its also means that N convex queries will be triggered and the sum the results on the client to avoid the 16K limit
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
Our dashboard is very dynamic, users can add or remove conditionals and we keep adding more by the time, so this idea becomes unpractical for our use case
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
My current best option is to export the data maybe to elasticsearch and then create endpoints to fetch it. Also I may configure a 5s pooler to keep the realtime capabilities although it isn't realtime
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
I fucked up the title, it was meant to be more than 16K (fixed)
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 9/10/2024 in #support-community
How to aggregate documents (more than 16K)?
Also denormalizing isn't an option because we also have tags, clients, departments, etc. for the invoices and need to also filter by that and count them.
21 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
It is a learning exercise, not a real product
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
Basically, Im trying to implement analytics with some filters, prefer on realtime
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
Yes, Im trying to implement real time analytics. Im working on this in my free time, I will clean the code and show you what Im trying to do
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
i'm just playing to see how far i can get with just convex
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
idk
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
only items sell during weekends
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
for example: orders with more than 5 items sell
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
search over aggregation
16 replies
CCConvex Community
•Created by Gary, el Pingüino Artefacto on 3/28/2024 in #support-community
Syncing with Elasticsearch or any search engine
I'm currently working around some indexes and the full text search, but I want to add some more complex aggregations and I understand that Convex isn't optimized for that
16 replies