Adam Harris Posts - Convex Community

Adam Harris

•Created by Adam Harris on 9/26/2024 in #support-community

Convex in deno workspace/monorepos

Hi, we're just looking into deno as a potential solution to simplify our typescript monorepo/npm workspace. Is anyone using convex with deno? If so, what's the recommended way of setting things up e.g. what's the recommended way of running convex dev? Is there a way to do this with a deno.json or do we need to keep things npm-based with a package.json?

2 replies

CCConvex Community

•Created by Adam Harris on 8/24/2024 in #support-community

How to count a large set of results from a query?

Hi, suppose I have a query such that the full set of results would be over the 16k convex limit. What is the best way/or are there any suggested techniques for counting this result set?

11 replies

CCConvex Community

•Created by Adam Harris on 8/9/2024 in #support-community

How to do an array contains query over a large table?

Hi, I have a table with over 100k docs and I have a field (fieldA) on the table, values of which are arrays of strings. What is the best way to find the documents in this table, such that the corresponding array at fieldA contains a certain string? It looks like convex doesn't support an arrayContains filter, and I can see the suggestion to read the full table into memory and then filter this using js...? But I think with a large table like this then this won't work because I will either hit the (~16k) document scan limit, or run out of memory?

3 replies

CCConvex Community

•Created by Adam Harris on 7/24/2024 in #support-community

Issue trying to import csv via Airbyte

Hi, I'm trying to import a csv into a Convex table via the Airbyte integration. I've successfully set up convex as a destination and I've tried to import the csv by using a Google sheet as an Airbyte source for the csv and also by using the File (CSV, JSON, Excel, Feather, Parquet) v0.5.3 Airbyte source (using a private AWS bucket). The full csv has around 23k rows. However if I take the first few (eg 20) rows from the csv and try and import that then it works fine via the AWS bucket. Here is the last error I got when trying to sync the full csv via the File connector:

Warning from destination: Something went wrong in the connector. See the logs for more details.

Expecting value: line 1 column 1 (char 0)

Warning from destination: Something went wrong in the connector. See the logs for more details.

Expecting value: line 1 column 1 (char 0)

4 replies

CCConvex Community

•Created by Adam Harris on 6/28/2024 in #support-community

Can't import snapshot to dev

Hi, I've exported a snapshot from production and I'm trying to import it into my dev instance. However when I try and do the import I'm getting the following error:

Hit an error while importing:
New table myTableName has IDs that conflict with existing table documents

Hit an error while importing:
New table myTableName has IDs that conflict with existing table documents

The steps I'm taking are as follows: - Clear all dev tables manually - Run a Snapshot Export on the (prod) dashboard - Run npx convex import —replace SNAPSHOT_NAME.zip When running the import, I see the following: Import change summary: table | create | delete | ---------------------------------------------- table1Name | 166 | 0 of 0 | table2Name | 1 | 0 of 0 | .... i.e. all tables are showing that nothing is in there to conflict... Any help with this would be much appreciated.

9 replies

CCConvex Community

•Created by Adam Harris on 6/12/2024 in #support-community

How do I test http actions locally?

Hi, I'd like to test my http actions locally i.e. by making requests to localhost. However when try and hit localhost:3000/myEndpoint, I'm getting 404s. The endpoint works in production, so I'm wondering why I'm getting a 404 locally...

4 replies